Jun 07 19:29:32.196795 ip-10-0-128-213 systemd[1]: Starting Kubernetes Kubelet... Jun 07 19:29:32.608636 ip-10-0-128-213 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 19:29:32.608636 ip-10-0-128-213 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 07 19:29:32.608636 ip-10-0-128-213 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 19:29:32.608636 ip-10-0-128-213 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 07 19:29:32.608636 ip-10-0-128-213 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 19:29:32.609827 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.609749 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 07 19:29:32.614051 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614036 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:29:32.614051 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614051 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614055 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614059 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614063 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614066 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614071 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614075 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614078 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614086 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614089 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614092 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614095 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614098 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614100 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614103 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614106 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614109 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614111 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614113 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:29:32.614152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614116 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614119 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614122 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614124 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614127 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614129 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614132 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614135 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614137 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614140 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614142 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614145 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614147 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614150 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614152 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614156 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614159 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614161 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614164 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614167 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:29:32.614622 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614170 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614172 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614175 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614177 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614180 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614183 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614185 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614187 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614190 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614192 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614196 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614199 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614201 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614203 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614206 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614209 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614213 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614216 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614219 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614222 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:29:32.615102 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614224 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614227 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614229 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614231 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614234 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614236 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614239 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614243 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614246 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614249 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614252 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614256 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614258 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614261 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614264 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614266 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614268 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614271 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614273 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:29:32.615609 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614276 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614280 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614283 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614286 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614289 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614291 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614294 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614298 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614300 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614303 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614306 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614308 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614311 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614313 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614316 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614318 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614321 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614323 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614326 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.614328 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:29:32.616075 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615024 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615031 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615034 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615037 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615040 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615043 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615046 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615049 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615051 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615054 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615056 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615059 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615062 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615064 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615066 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615069 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615072 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615074 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615077 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615079 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:29:32.616565 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615082 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615084 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615087 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615089 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615093 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615095 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615098 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615100 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615103 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615105 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615108 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615111 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615114 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615116 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615119 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615122 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615125 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615127 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615131 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:29:32.617085 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615134 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615137 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615139 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615141 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615146 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615149 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615152 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615155 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615157 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615160 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615163 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615166 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615169 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615171 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615174 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615177 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615180 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615182 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615185 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:29:32.617556 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615187 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615190 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615193 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615195 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615198 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615200 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615205 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615209 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615212 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615214 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615217 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615220 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615222 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615228 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615230 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615232 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615235 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615238 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615240 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615242 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:29:32.618033 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615245 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615247 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615250 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615252 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615255 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615257 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615259 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615262 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615265 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615267 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615270 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615272 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615277 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615280 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615283 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615285 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615290 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615293 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615296 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615299 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:29:32.618537 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615301 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615687 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615692 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615695 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615698 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615701 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615703 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615706 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615709 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615712 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615715 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615717 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615720 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615723 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615725 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615728 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615731 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615733 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615736 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:29:32.619027 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615738 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615742 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615744 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615747 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615750 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615753 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615755 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615758 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615760 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615763 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615766 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615768 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615771 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615773 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615776 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615779 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615783 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615786 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615789 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:29:32.619505 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615792 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615798 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615801 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615804 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615806 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615809 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615812 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615814 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615817 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615819 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615822 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615825 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615827 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615830 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615833 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615835 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615838 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615840 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615843 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615846 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:29:32.619959 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615849 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615852 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615854 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615857 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615859 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615862 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615864 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615867 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615869 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615872 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615875 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615877 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615880 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615883 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615886 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615888 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615891 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615893 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615897 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615900 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:29:32.620455 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615903 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615906 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615912 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615915 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615918 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615920 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615923 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615925 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615928 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615930 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615933 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615935 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615938 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615941 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615943 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615946 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615948 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615951 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615953 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615956 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:29:32.620933 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615958 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.615961 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616034 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616041 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616047 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616051 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616056 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616059 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616062 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616067 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616070 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616073 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616076 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616080 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616085 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616088 2562 flags.go:64] FLAG: --cgroup-root="" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616091 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616094 2562 flags.go:64] FLAG: --client-ca-file="" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616097 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616100 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616105 2562 flags.go:64] FLAG: --cluster-domain="" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616107 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616110 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616114 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 07 19:29:32.621429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616117 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616121 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616124 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616127 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616130 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616132 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616135 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616138 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616141 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616144 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616148 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616152 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616154 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616157 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616160 2562 flags.go:64] FLAG: --enable-server="true" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616163 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616168 2562 flags.go:64] FLAG: --event-burst="100" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616171 2562 flags.go:64] FLAG: --event-qps="50" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616174 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616178 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616181 2562 flags.go:64] FLAG: --eviction-hard="" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616185 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616188 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616191 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616194 2562 flags.go:64] FLAG: --eviction-soft="" Jun 07 19:29:32.622009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616197 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616200 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616203 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616206 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616209 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616211 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616214 2562 flags.go:64] FLAG: --feature-gates="" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616218 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616221 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616224 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616227 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616230 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616233 2562 flags.go:64] FLAG: --help="false" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616235 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616238 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616241 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616244 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616247 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616250 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616253 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616256 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616258 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616261 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 07 19:29:32.622812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616264 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616267 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616270 2562 flags.go:64] FLAG: --kube-reserved="" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616277 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616280 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616283 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616286 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616289 2562 flags.go:64] FLAG: --lock-file="" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616292 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616295 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616298 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616303 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616306 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616309 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616312 2562 flags.go:64] FLAG: --logging-format="text" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616315 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616318 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616321 2562 flags.go:64] FLAG: --manifest-url="" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616324 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616328 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616331 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616335 2562 flags.go:64] FLAG: --max-pods="110" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616338 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616341 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616344 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 07 19:29:32.623956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616347 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616350 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616352 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616355 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616362 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616365 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616368 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616371 2562 flags.go:64] FLAG: --pod-cidr="" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616374 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616379 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616384 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616387 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616390 2562 flags.go:64] FLAG: --port="10250" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616393 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616396 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08483f5dcc688c332" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616399 2562 flags.go:64] FLAG: --qos-reserved="" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616402 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616405 2562 flags.go:64] FLAG: --register-node="true" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616408 2562 flags.go:64] FLAG: --register-with-taints="" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616425 2562 flags.go:64] FLAG: --registry-burst="10" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616428 2562 flags.go:64] FLAG: --registry-qps="5" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616431 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616433 2562 flags.go:64] FLAG: --reserved-memory="" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616437 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616440 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 07 19:29:32.625043 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616443 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616446 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616449 2562 flags.go:64] FLAG: --runonce="false" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616452 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616455 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616457 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616460 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616463 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616466 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616469 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616472 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616475 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616477 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616480 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616483 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616486 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616489 2562 flags.go:64] FLAG: --system-cgroups="" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616493 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616499 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616501 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616504 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616508 2562 flags.go:64] FLAG: --tls-min-version="" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616511 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616514 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616517 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 07 19:29:32.625697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616519 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616522 2562 flags.go:64] FLAG: --v="2" Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616526 2562 flags.go:64] FLAG: --version="false" Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616530 2562 flags.go:64] FLAG: --vmodule="" Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616538 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.616541 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616652 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616656 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616659 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616661 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616664 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616666 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616669 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616672 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616674 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616676 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616679 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616681 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616684 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616686 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616689 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616691 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:29:32.626608 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616694 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616697 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616701 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616703 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616706 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616709 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616713 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616715 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616718 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616720 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616723 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616725 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616728 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616730 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616733 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616735 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616738 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616741 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616743 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616746 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:29:32.627566 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616748 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616751 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616754 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616756 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616759 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616761 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616765 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616769 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616772 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616774 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616777 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616779 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616782 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616784 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616788 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616792 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616795 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616797 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616801 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:29:32.628199 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616804 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616806 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616810 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616814 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616817 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616819 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616833 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616836 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616838 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616841 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616843 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616846 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616849 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616851 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616854 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616857 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616859 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616862 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616864 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:29:32.629004 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616867 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616870 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616872 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616875 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616877 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616880 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616882 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616885 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616890 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616893 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616897 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616900 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616904 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616907 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616910 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616913 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616915 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616918 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616920 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:29:32.629669 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616923 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616926 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616928 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616931 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616933 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.616936 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.617578 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.625046 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.625063 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.626046 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.626064 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626152 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626161 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626166 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626171 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:29:32.630273 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626177 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626183 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626188 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626192 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626196 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626201 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626205 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626210 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626215 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626220 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626224 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626228 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626232 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626237 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626241 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626246 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626250 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626254 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626259 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626264 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:29:32.630714 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626268 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626272 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626276 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626280 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626285 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626290 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626295 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626299 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626304 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626308 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626312 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626316 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626320 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626324 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626328 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626332 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626336 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626340 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626347 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:29:32.631191 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626353 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626358 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626363 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626368 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626373 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626377 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626382 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626386 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626390 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626395 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626399 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626403 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626407 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626428 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626432 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626436 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626440 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626445 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626449 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:29:32.631715 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626455 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626459 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626463 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626467 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626474 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626479 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626484 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626488 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626493 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626497 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626502 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626506 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626511 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626515 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626519 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626525 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626531 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626536 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626540 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:29:32.632167 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626544 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626548 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626552 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626556 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626561 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626565 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626569 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626574 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626578 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626582 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626586 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626590 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626595 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626599 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626603 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626607 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626611 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:29:32.632805 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626615 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.626622 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626791 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626798 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626803 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626808 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626813 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626817 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626821 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626827 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626833 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626838 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626843 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626848 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626853 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:29:32.633216 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626857 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626862 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626867 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626872 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626876 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626880 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626885 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626889 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626894 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626898 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626903 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626908 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626912 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626916 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626920 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626925 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626929 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626932 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626937 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626941 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:29:32.633631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626945 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626949 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626953 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626958 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626962 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626966 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626970 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626974 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626979 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626983 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626987 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626994 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.626999 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627005 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627011 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627015 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627020 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627024 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627028 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627033 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:29:32.634113 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627037 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627041 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627045 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627049 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627054 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627058 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627062 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627066 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627070 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627075 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627079 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627083 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627087 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627091 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627096 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627101 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627105 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627109 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627176 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:29:32.634937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627186 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627191 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627196 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627201 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627205 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627211 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627215 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627220 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627225 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627229 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627233 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627238 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627242 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627246 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627250 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627254 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627259 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627263 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627267 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:29:32.635597 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627271 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627275 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627279 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627284 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627288 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627292 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627296 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:32.627300 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.627308 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.627467 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.630035 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.631460 2562 server.go:1019] "Starting client certificate rotation" Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.631567 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 19:29:32.636051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.632187 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 19:29:32.636366 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.634919 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 19:29:32.643460 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.643434 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 19:29:32.653220 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.653199 2562 log.go:25] "Validated CRI v1 runtime API" Jun 07 19:29:32.655796 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.655779 2562 log.go:25] "Validated CRI v1 image API" Jun 07 19:29:32.656656 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.656640 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 07 19:29:32.660084 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.660059 2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a94da355-2adf-43e5-be7a-1df82d881300:/dev/nvme0n1p4 aaa4a777-5013-418b-917b-1c921b8308f2:/dev/nvme0n1p3] Jun 07 19:29:32.660139 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.660083 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 07 19:29:32.665233 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.665118 2562 manager.go:216] Machine: {Timestamp:2026-06-07 19:29:32.663786125 +0000 UTC m=+0.338811015 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097607 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20f7ec3982939e3c2532eaffd0d50b SystemUUID:ec20f7ec-3982-939e-3c25-32eaffd0d50b BootID:3b0c7bce-8613-42d2-9d77-f6d92e6f6358 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:18:9a:43:96:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:18:9a:43:96:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:a9:e8:11:ee:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 07 19:29:32.665233 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.665226 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 07 19:29:32.665363 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.665306 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 07 19:29:32.666163 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.666136 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 19:29:32.668288 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.668259 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 07 19:29:32.668441 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.668291 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-213.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 07 19:29:32.669012 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.669003 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 07 19:29:32.669051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.669015 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 07 19:29:32.669051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.669023 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 19:29:32.670465 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.670455 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 19:29:32.671228 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.671218 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 07 19:29:32.673763 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.673751 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 07 19:29:32.673896 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.673886 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 07 19:29:32.673932 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.673915 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 07 19:29:32.673932 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.673926 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 07 19:29:32.674002 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.673941 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 07 19:29:32.674002 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.673951 2562 kubelet.go:398] "Adding apiserver pod source" Jun 07 19:29:32.674002 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.673959 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 07 19:29:32.674318 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.674307 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 19:29:32.674361 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.674325 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 19:29:32.676638 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.676619 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 07 19:29:32.678124 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.677962 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 07 19:29:32.678124 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.677993 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 07 19:29:32.678974 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.678961 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 07 19:29:32.679018 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.678977 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 07 19:29:32.679018 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.678983 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 07 19:29:32.679018 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.678989 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 07 19:29:32.679018 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.678997 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 07 19:29:32.679018 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.679006 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 07 19:29:32.679018 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.679016 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 07 19:29:32.679175 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.679021 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 07 19:29:32.679175 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.679029 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 07 19:29:32.679175 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.679034 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 07 19:29:32.679175 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.679043 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 07 19:29:32.679175 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.679048 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 07 19:29:32.679798 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.679788 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 07 19:29:32.679840 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.679800 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 07 19:29:32.683245 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.683231 2562 server.go:1268] "Started kubelet" Jun 07 19:29:32.683367 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.683299 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 07 19:29:32.683778 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.683299 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 07 19:29:32.683864 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.683804 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 07 19:29:32.684535 ip-10-0-128-213 systemd[1]: Started Kubernetes Kubelet. Jun 07 19:29:32.688387 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.688370 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 07 19:29:32.689985 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.689957 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 07 19:29:32.690078 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.689980 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 07 19:29:32.690078 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.690001 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 07 19:29:32.690242 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.690225 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pf554" Jun 07 19:29:32.690507 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.690492 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 07 19:29:32.690565 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.690548 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 07 19:29:32.692214 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.692195 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 07 19:29:32.692214 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.692208 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 07 19:29:32.692337 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.692300 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:32.692647 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.691629 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-213.ec2.internal.18b6e3416547fb82 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-213.ec2.internal,UID:ip-10-0-128-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-213.ec2.internal,},FirstTimestamp:2026-06-07 19:29:32.683205506 +0000 UTC m=+0.358230395,LastTimestamp:2026-06-07 19:29:32.683205506 +0000 UTC m=+0.358230395,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-213.ec2.internal,}" Jun 07 19:29:32.692835 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.692803 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 07 19:29:32.692835 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.692836 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 07 19:29:32.692973 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.692892 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 07 19:29:32.692973 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.692971 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 07 19:29:32.693062 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.692981 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 07 19:29:32.693150 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.693134 2562 factory.go:55] Registering systemd factory Jun 07 19:29:32.693207 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.693156 2562 factory.go:223] Registration of the systemd container factory successfully Jun 07 19:29:32.693772 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.693403 2562 factory.go:153] Registering CRI-O factory Jun 07 19:29:32.693772 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.693434 2562 factory.go:223] Registration of the crio container factory successfully Jun 07 19:29:32.693772 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.693486 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 07 19:29:32.693772 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.693514 2562 factory.go:103] Registering Raw factory Jun 07 19:29:32.693772 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.693531 2562 manager.go:1196] Started watching for new ooms in manager Jun 07 19:29:32.694030 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.693949 2562 manager.go:349] Starting recovery of all containers Jun 07 19:29:32.695514 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.695367 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 07 19:29:32.695514 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.695501 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 07 19:29:32.696497 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.696470 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pf554" Jun 07 19:29:32.703815 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.703798 2562 manager.go:354] Recovery completed Jun 07 19:29:32.705098 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.705081 2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 07 19:29:32.709107 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.709094 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:29:32.711107 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.711093 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:29:32.711173 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.711120 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:29:32.711173 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.711132 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:29:32.711761 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.711748 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 07 19:29:32.711817 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.711768 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 07 19:29:32.711817 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.711760 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:29:32.711817 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.711788 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 07 19:29:32.712505 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.712490 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:29:32.712555 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.712517 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:29:32.712555 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.712529 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:29:32.712989 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.712967 2562 policy_none.go:49] "None policy: Start" Jun 07 19:29:32.713026 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.712993 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 07 19:29:32.713026 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.713004 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 07 19:29:32.713090 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.713007 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-213.ec2.internal.18b6e34166f1ba5d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-213.ec2.internal,UID:ip-10-0-128-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-213.ec2.internal,},FirstTimestamp:2026-06-07 19:29:32.711107165 +0000 UTC m=+0.386132054,LastTimestamp:2026-06-07 19:29:32.711107165 +0000 UTC m=+0.386132054,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-213.ec2.internal,}" Jun 07 19:29:32.713828 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.713817 2562 policy_none.go:47] "Start" Jun 07 19:29:32.749019 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.749002 2562 manager.go:337] "Starting Device Plugin manager" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.749050 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.749078 2562 server.go:87] "Starting device plugin registration server" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.749393 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.749433 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.749536 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.749649 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.749659 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.750229 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.750282 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.752614 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.753789 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.753822 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.753845 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.753893 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 07 19:29:32.757134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.755709 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 19:29:32.849842 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.849810 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:29:32.851033 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.851009 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:29:32.851146 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.851048 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:29:32.851146 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.851058 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:29:32.851146 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.851084 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.854105 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.854087 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal"] Jun 07 19:29:32.854160 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.854146 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:29:32.855786 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.855759 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:29:32.855901 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.855794 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:29:32.855901 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.855807 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:29:32.857006 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.856993 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:29:32.857123 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.857104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.857170 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.857141 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:29:32.857741 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.857725 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:29:32.857811 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.857757 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:29:32.857811 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.857768 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:29:32.857811 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.857725 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:29:32.857956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.857832 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:29:32.857956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.857845 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:29:32.858840 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.858824 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.858901 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.858852 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-213.ec2.internal\": node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:32.859009 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.858995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.859053 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.859021 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:29:32.859724 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.859707 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:29:32.859833 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.859732 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:29:32.859833 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.859741 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:29:32.871823 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.871783 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:32.883125 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.883109 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-213.ec2.internal\" not found" node="ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.887493 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.887477 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-213.ec2.internal\" not found" node="ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.894087 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.894070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/acfcef4dd4d5a3f67551d8b6c9d7a22b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"acfcef4dd4d5a3f67551d8b6c9d7a22b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.894175 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.894093 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acfcef4dd4d5a3f67551d8b6c9d7a22b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"acfcef4dd4d5a3f67551d8b6c9d7a22b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.894175 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.894109 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a8c5dee304fa10b5807d1a06407eb73-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"3a8c5dee304fa10b5807d1a06407eb73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.972549 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:32.972514 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:32.995097 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.995073 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/acfcef4dd4d5a3f67551d8b6c9d7a22b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"acfcef4dd4d5a3f67551d8b6c9d7a22b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.995184 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.995102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acfcef4dd4d5a3f67551d8b6c9d7a22b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"acfcef4dd4d5a3f67551d8b6c9d7a22b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.995184 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.995133 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a8c5dee304fa10b5807d1a06407eb73-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"3a8c5dee304fa10b5807d1a06407eb73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.995278 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.995181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/acfcef4dd4d5a3f67551d8b6c9d7a22b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"acfcef4dd4d5a3f67551d8b6c9d7a22b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.995278 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.995228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acfcef4dd4d5a3f67551d8b6c9d7a22b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"acfcef4dd4d5a3f67551d8b6c9d7a22b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jun 07 19:29:32.995278 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:32.995255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a8c5dee304fa10b5807d1a06407eb73-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"3a8c5dee304fa10b5807d1a06407eb73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jun 07 19:29:33.072660 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:33.072631 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:33.173348 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:33.173274 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:33.186616 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:33.186584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jun 07 19:29:33.191482 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:33.191468 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jun 07 19:29:33.273888 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:33.273860 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:33.374330 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:33.374299 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:33.474896 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:33.474825 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:33.575376 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:33.575346 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:33.623980 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:33.623954 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 19:29:33.631335 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:33.631315 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 07 19:29:33.631472 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:33.631455 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 19:29:33.631516 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:33.631488 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 19:29:33.675709 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:33.675683 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:33.699089 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:33.699052 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-06 19:24:32 +0000 UTC" deadline="2028-01-28 20:47:38.66265375 +0000 UTC" Jun 07 19:29:33.699089 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:33.699080 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14401h18m4.963578149s" Jun 07 19:29:33.719816 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:33.719788 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfcef4dd4d5a3f67551d8b6c9d7a22b.slice/crio-7a005d8c83d743d3636e29d00c3a06818ffec9071908c5cc3ca7db7b67549395 WatchSource:0}: Error finding container 7a005d8c83d743d3636e29d00c3a06818ffec9071908c5cc3ca7db7b67549395: Status 404 returned error can't find the container with id 7a005d8c83d743d3636e29d00c3a06818ffec9071908c5cc3ca7db7b67549395 Jun 07 19:29:33.719992 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:33.719973 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a8c5dee304fa10b5807d1a06407eb73.slice/crio-8c61716bf45a8fca1db32fe62a14a7d71efecd997612873494007c45d202f511 WatchSource:0}: Error finding container 8c61716bf45a8fca1db32fe62a14a7d71efecd997612873494007c45d202f511: Status 404 returned error can't find the container with id 8c61716bf45a8fca1db32fe62a14a7d71efecd997612873494007c45d202f511 Jun 07 19:29:33.726516 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:33.726498 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 19:29:33.756572 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:33.756527 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" event={"ID":"3a8c5dee304fa10b5807d1a06407eb73","Type":"ContainerStarted","Data":"8c61716bf45a8fca1db32fe62a14a7d71efecd997612873494007c45d202f511"} Jun 07 19:29:33.757493 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:33.757474 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"acfcef4dd4d5a3f67551d8b6c9d7a22b","Type":"ContainerStarted","Data":"7a005d8c83d743d3636e29d00c3a06818ffec9071908c5cc3ca7db7b67549395"} Jun 07 19:29:33.776640 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:33.776610 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:33.877183 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:33.877157 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:33.977681 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:33.977620 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jun 07 19:29:34.009612 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.009588 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 19:29:34.020494 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.020473 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 19:29:34.092694 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.092668 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jun 07 19:29:34.102472 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.102454 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 19:29:34.103686 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.103674 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jun 07 19:29:34.111012 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.110996 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 19:29:34.674728 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.674696 2562 apiserver.go:52] "Watching apiserver" Jun 07 19:29:34.681245 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.681222 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 07 19:29:34.682659 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.682634 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-7d8dl","kube-system/konnectivity-agent-mcnhd","kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv","openshift-image-registry/node-ca-gf466","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal","openshift-multus/multus-additional-cni-plugins-7ltqm","openshift-multus/network-metrics-daemon-mdddh","openshift-cluster-node-tuning-operator/tuned-fcd6x","openshift-dns/node-resolver-pw76s","openshift-multus/multus-rx555","openshift-network-diagnostics/network-check-target-m2zz9","openshift-network-operator/iptables-alerter-kbbdj","openshift-ovn-kubernetes/ovnkube-node-k8xwp"] Jun 07 19:29:34.685322 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.685301 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.687465 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.687446 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kbbdj" Jun 07 19:29:34.687896 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.687861 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 07 19:29:34.688198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.688111 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 07 19:29:34.688198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.688116 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 07 19:29:34.688408 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.688378 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zlqn4\"" Jun 07 19:29:34.688408 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.688428 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 07 19:29:34.688654 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.688455 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 07 19:29:34.689650 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.689628 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 07 19:29:34.689746 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.689629 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-72g2l\"" Jun 07 19:29:34.689746 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.689670 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 07 19:29:34.689746 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.689726 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 07 19:29:34.690035 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.690011 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.692110 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.692090 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 07 19:29:34.692214 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.692153 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 07 19:29:34.692214 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.692192 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.692315 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.692282 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 07 19:29:34.694197 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.692931 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 07 19:29:34.694197 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.693245 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f2wzt\"" Jun 07 19:29:34.694197 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.693305 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 07 19:29:34.694197 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.693446 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 07 19:29:34.695091 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.695067 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 07 19:29:34.696111 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.695642 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-98n8j\"" Jun 07 19:29:34.696111 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.695699 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gf466" Jun 07 19:29:34.696111 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.695894 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 07 19:29:34.696298 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.696250 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 07 19:29:34.696298 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.696252 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 07 19:29:34.697964 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.697940 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 07 19:29:34.698123 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.698106 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:34.698205 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.698173 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fn78s\"" Jun 07 19:29:34.698205 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:34.698178 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:34.698322 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.698176 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 07 19:29:34.698536 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.698519 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 07 19:29:34.700716 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.700695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.702778 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.702758 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 07 19:29:34.702927 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.702906 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xtg5v\"" Jun 07 19:29:34.702992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.702938 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 07 19:29:34.703066 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.703045 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:34.703162 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:34.703110 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:34.705519 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705496 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:34.705602 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705519 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-kubelet\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.705602 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-systemd-units\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.705711 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.705711 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705631 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-socket-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.705711 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-run-systemd\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.705865 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-var-lib-openvswitch\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.705865 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhc75\" (UniqueName: \"kubernetes.io/projected/d3fc3522-740a-4477-8591-8d650ac06837-kube-api-access-dhc75\") pod \"iptables-alerter-kbbdj\" (UID: \"d3fc3522-740a-4477-8591-8d650ac06837\") " pod="openshift-network-operator/iptables-alerter-kbbdj" Jun 07 19:29:34.705865 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25038978-89b5-4e4f-a340-26505aabda95-host\") pod \"node-ca-gf466\" (UID: \"25038978-89b5-4e4f-a340-26505aabda95\") " pod="openshift-image-registry/node-ca-gf466" Jun 07 19:29:34.706012 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25038978-89b5-4e4f-a340-26505aabda95-serviceca\") pod \"node-ca-gf466\" (UID: \"25038978-89b5-4e4f-a340-26505aabda95\") " pod="openshift-image-registry/node-ca-gf466" Jun 07 19:29:34.706012 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-os-release\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.706012 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9ssl\" (UniqueName: \"kubernetes.io/projected/ee17169b-0931-4861-97d5-84510bf566a3-kube-api-access-v9ssl\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.706012 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.705999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-cni-netd\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.706205 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2mkq\" (UniqueName: \"kubernetes.io/projected/caf9750f-6777-4212-88b5-68ea78e99972-kube-api-access-x2mkq\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.706205 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706064 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3fc3522-740a-4477-8591-8d650ac06837-host-slash\") pod \"iptables-alerter-kbbdj\" (UID: \"d3fc3522-740a-4477-8591-8d650ac06837\") " pod="openshift-network-operator/iptables-alerter-kbbdj" Jun 07 19:29:34.706205 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/caf9750f-6777-4212-88b5-68ea78e99972-ovn-node-metrics-cert\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.706205 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-device-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.706205 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-etc-selinux\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.706205 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96466\" (UniqueName: \"kubernetes.io/projected/25038978-89b5-4e4f-a340-26505aabda95-kube-api-access-96466\") pod \"node-ca-gf466\" (UID: \"25038978-89b5-4e4f-a340-26505aabda95\") " pod="openshift-image-registry/node-ca-gf466" Jun 07 19:29:34.706205 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3fc3522-740a-4477-8591-8d650ac06837-iptables-alerter-script\") pod \"iptables-alerter-kbbdj\" (UID: \"d3fc3522-740a-4477-8591-8d650ac06837\") " pod="openshift-network-operator/iptables-alerter-kbbdj" Jun 07 19:29:34.706205 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-slash\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-run-netns\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-log-socket\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706265 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-registration-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-sys-fs\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706346 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-system-cni-dir\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706376 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-run-ovn\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-node-log\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-cni-bin\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/caf9750f-6777-4212-88b5-68ea78e99972-env-overrides\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706484 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mj6m\" (UniqueName: \"kubernetes.io/projected/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-kube-api-access-4mj6m\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706507 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee17169b-0931-4861-97d5-84510bf566a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee17169b-0931-4861-97d5-84510bf566a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.706588 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706567 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-run-openvswitch\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.707307 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.707307 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee17169b-0931-4861-97d5-84510bf566a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.707307 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-etc-openvswitch\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.707307 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/caf9750f-6777-4212-88b5-68ea78e99972-ovnkube-config\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.707307 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706732 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/caf9750f-6777-4212-88b5-68ea78e99972-ovnkube-script-lib\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.707307 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.706748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-cnibin\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.707678 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.707658 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 19:29:34.707828 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.707777 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pw76s" Jun 07 19:29:34.707893 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.707824 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 07 19:29:34.707893 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.707876 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 07 19:29:34.708206 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.708190 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rjp54\"" Jun 07 19:29:34.710031 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.709920 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 07 19:29:34.710031 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.710000 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vn9b2\"" Jun 07 19:29:34.710513 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.710233 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rx555" Jun 07 19:29:34.710513 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.710367 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 07 19:29:34.712306 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.712286 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 07 19:29:34.712389 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.712377 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kwljp\"" Jun 07 19:29:34.712521 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.712509 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:34.712588 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:34.712570 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:34.729090 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.729067 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-28q7c" Jun 07 19:29:34.736534 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.736515 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-28q7c" Jun 07 19:29:34.794550 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.794527 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 07 19:29:34.807484 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/caf9750f-6777-4212-88b5-68ea78e99972-ovn-node-metrics-cert\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.807623 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807590 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-run-k8s-cni-cncf-io\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.807691 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807625 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-modprobe-d\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.807691 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-kubernetes\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.807691 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-sysctl-conf\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.807838 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-etc-selinux\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.807838 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-run-netns\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.807838 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-var-lib-cni-multus\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.807838 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807777 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-tuned\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.807838 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-etc-selinux\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.807838 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-run-ovn\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.807838 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807798 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 07 19:29:34.807838 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807815 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-run-netns\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.807838 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807839 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-run-ovn\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-node-log\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807909 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-node-log\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-var-lib-kubelet\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr9b8\" (UniqueName: \"kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8\") pod \"network-check-target-m2zz9\" (UID: \"202249b4-4a9b-4118-94d8-a63381d5d0cd\") " pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.807984 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee17169b-0931-4861-97d5-84510bf566a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63-tmp-dir\") pod \"node-resolver-pw76s\" (UID: \"d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63\") " pod="openshift-dns/node-resolver-pw76s" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-etc-kubernetes\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee17169b-0931-4861-97d5-84510bf566a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808087 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808111 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/caf9750f-6777-4212-88b5-68ea78e99972-ovnkube-script-lib\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-run-netns\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808153 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bfa1f9c-5189-4fb5-878b-33c9a863b692-tmp\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64239ea5-bafa-4f7c-a183-232428d1c219-konnectivity-ca\") pod \"konnectivity-agent-mcnhd\" (UID: \"64239ea5-bafa-4f7c-a183-232428d1c219\") " pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-kubelet\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808242 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-kubelet\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.808370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-systemd-units\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-run\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808341 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-systemd-units\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-socket-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808389 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-run-systemd\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-cnibin\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgg9s\" (UniqueName: \"kubernetes.io/projected/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-kube-api-access-fgg9s\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808472 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-run-systemd\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-systemd\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-socket-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhc75\" (UniqueName: \"kubernetes.io/projected/d3fc3522-740a-4477-8591-8d650ac06837-kube-api-access-dhc75\") pod \"iptables-alerter-kbbdj\" (UID: \"d3fc3522-740a-4477-8591-8d650ac06837\") " pod="openshift-network-operator/iptables-alerter-kbbdj" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808537 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25038978-89b5-4e4f-a340-26505aabda95-host\") pod \"node-ca-gf466\" (UID: \"25038978-89b5-4e4f-a340-26505aabda95\") " pod="openshift-image-registry/node-ca-gf466" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25038978-89b5-4e4f-a340-26505aabda95-serviceca\") pod \"node-ca-gf466\" (UID: \"25038978-89b5-4e4f-a340-26505aabda95\") " pod="openshift-image-registry/node-ca-gf466" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808564 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee17169b-0931-4861-97d5-84510bf566a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808599 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25038978-89b5-4e4f-a340-26505aabda95-host\") pod \"node-ca-gf466\" (UID: \"25038978-89b5-4e4f-a340-26505aabda95\") " pod="openshift-image-registry/node-ca-gf466" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee17169b-0931-4861-97d5-84510bf566a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-os-release\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.809186 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9ssl\" (UniqueName: \"kubernetes.io/projected/ee17169b-0931-4861-97d5-84510bf566a3-kube-api-access-v9ssl\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-cni-netd\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2mkq\" (UniqueName: \"kubernetes.io/projected/caf9750f-6777-4212-88b5-68ea78e99972-kube-api-access-x2mkq\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-sys\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808739 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-os-release\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808774 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-cni-netd\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3fc3522-740a-4477-8591-8d650ac06837-host-slash\") pod \"iptables-alerter-kbbdj\" (UID: \"d3fc3522-740a-4477-8591-8d650ac06837\") " pod="openshift-network-operator/iptables-alerter-kbbdj" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2mvw\" (UniqueName: \"kubernetes.io/projected/d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63-kube-api-access-c2mvw\") pod \"node-resolver-pw76s\" (UID: \"d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63\") " pod="openshift-dns/node-resolver-pw76s" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808934 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25038978-89b5-4e4f-a340-26505aabda95-serviceca\") pod \"node-ca-gf466\" (UID: \"25038978-89b5-4e4f-a340-26505aabda95\") " pod="openshift-image-registry/node-ca-gf466" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808949 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3fc3522-740a-4477-8591-8d650ac06837-host-slash\") pod \"iptables-alerter-kbbdj\" (UID: \"d3fc3522-740a-4477-8591-8d650ac06837\") " pod="openshift-network-operator/iptables-alerter-kbbdj" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.808989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-lib-modules\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-host\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64239ea5-bafa-4f7c-a183-232428d1c219-agent-certs\") pod \"konnectivity-agent-mcnhd\" (UID: \"64239ea5-bafa-4f7c-a183-232428d1c219\") " pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-device-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96466\" (UniqueName: \"kubernetes.io/projected/25038978-89b5-4e4f-a340-26505aabda95-kube-api-access-96466\") pod \"node-ca-gf466\" (UID: \"25038978-89b5-4e4f-a340-26505aabda95\") " pod="openshift-image-registry/node-ca-gf466" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3fc3522-740a-4477-8591-8d650ac06837-iptables-alerter-script\") pod \"iptables-alerter-kbbdj\" (UID: \"d3fc3522-740a-4477-8591-8d650ac06837\") " pod="openshift-network-operator/iptables-alerter-kbbdj" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-slash\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.809869 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809215 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-device-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-log-socket\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809267 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-log-socket\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-os-release\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809361 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-slash\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809374 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/caf9750f-6777-4212-88b5-68ea78e99972-ovnkube-script-lib\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-daemon-config\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-registration-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-sys-fs\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-system-cni-dir\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-cni-bin\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809530 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-registration-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809537 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-sys-fs\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/caf9750f-6777-4212-88b5-68ea78e99972-env-overrides\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-cni-binary-copy\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.810573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809608 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mj6m\" (UniqueName: \"kubernetes.io/projected/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-kube-api-access-4mj6m\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809615 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-host-cni-bin\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809644 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee17169b-0931-4861-97d5-84510bf566a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809582 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-system-cni-dir\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-run-openvswitch\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-socket-dir-parent\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-hostroot\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809813 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3fc3522-740a-4477-8591-8d650ac06837-iptables-alerter-script\") pod \"iptables-alerter-kbbdj\" (UID: \"d3fc3522-740a-4477-8591-8d650ac06837\") " pod="openshift-network-operator/iptables-alerter-kbbdj" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-etc-openvswitch\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809881 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-run-openvswitch\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809889 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-etc-openvswitch\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/caf9750f-6777-4212-88b5-68ea78e99972-ovnkube-config\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809930 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-run-multus-certs\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:34.811115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-var-lib-kubelet\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.809997 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cc9010f-e635-417d-8648-16996ea61a8d-dbus\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-cnibin\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810045 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63-hosts-file\") pod \"node-resolver-pw76s\" (UID: \"d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63\") " pod="openshift-dns/node-resolver-pw76s" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/caf9750f-6777-4212-88b5-68ea78e99972-env-overrides\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee17169b-0931-4861-97d5-84510bf566a3-cnibin\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-cni-dir\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-var-lib-cni-bin\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810196 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee17169b-0931-4861-97d5-84510bf566a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shr2d\" (UniqueName: \"kubernetes.io/projected/4bfa1f9c-5189-4fb5-878b-33c9a863b692-kube-api-access-shr2d\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cc9010f-e635-417d-8648-16996ea61a8d-kubelet-config\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810281 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-var-lib-openvswitch\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810352 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-conf-dir\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810386 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/caf9750f-6777-4212-88b5-68ea78e99972-ovnkube-config\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810445 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/caf9750f-6777-4212-88b5-68ea78e99972-var-lib-openvswitch\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.811729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-sysconfig\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.812290 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-sysctl-d\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.812290 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-system-cni-dir\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.812290 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.810546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crfrc\" (UniqueName: \"kubernetes.io/projected/4bd39616-fa08-4d64-975d-b9bb523de55f-kube-api-access-crfrc\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:34.812290 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.811361 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/caf9750f-6777-4212-88b5-68ea78e99972-ovn-node-metrics-cert\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.824791 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.824765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96466\" (UniqueName: \"kubernetes.io/projected/25038978-89b5-4e4f-a340-26505aabda95-kube-api-access-96466\") pod \"node-ca-gf466\" (UID: \"25038978-89b5-4e4f-a340-26505aabda95\") " pod="openshift-image-registry/node-ca-gf466" Jun 07 19:29:34.825047 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.825024 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mj6m\" (UniqueName: \"kubernetes.io/projected/808ddad5-35a8-4725-abaf-14ba7e9d3bc8-kube-api-access-4mj6m\") pod \"aws-ebs-csi-driver-node-ghkxv\" (UID: \"808ddad5-35a8-4725-abaf-14ba7e9d3bc8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:34.825126 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.825094 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2mkq\" (UniqueName: \"kubernetes.io/projected/caf9750f-6777-4212-88b5-68ea78e99972-kube-api-access-x2mkq\") pod \"ovnkube-node-k8xwp\" (UID: \"caf9750f-6777-4212-88b5-68ea78e99972\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:34.826820 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.826799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9ssl\" (UniqueName: \"kubernetes.io/projected/ee17169b-0931-4861-97d5-84510bf566a3-kube-api-access-v9ssl\") pod \"multus-additional-cni-plugins-7ltqm\" (UID: \"ee17169b-0931-4861-97d5-84510bf566a3\") " pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:34.826916 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.826898 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhc75\" (UniqueName: \"kubernetes.io/projected/d3fc3522-740a-4477-8591-8d650ac06837-kube-api-access-dhc75\") pod \"iptables-alerter-kbbdj\" (UID: \"d3fc3522-740a-4477-8591-8d650ac06837\") " pod="openshift-network-operator/iptables-alerter-kbbdj" Jun 07 19:29:34.878714 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.878685 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 19:29:34.911595 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911569 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-conf-dir\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.911595 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-sysconfig\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.911813 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-sysctl-d\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.911813 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-system-cni-dir\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.911813 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crfrc\" (UniqueName: \"kubernetes.io/projected/4bd39616-fa08-4d64-975d-b9bb523de55f-kube-api-access-crfrc\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:34.911813 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-system-cni-dir\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.911813 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911720 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-sysconfig\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.911813 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-conf-dir\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.911813 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-run-k8s-cni-cncf-io\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.911813 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-modprobe-d\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.911813 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-kubernetes\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911792 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-run-k8s-cni-cncf-io\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911769 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-sysctl-d\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911859 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-kubernetes\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-sysctl-conf\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-modprobe-d\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-var-lib-cni-multus\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911926 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-var-lib-cni-multus\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-tuned\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-var-lib-kubelet\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9b8\" (UniqueName: \"kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8\") pod \"network-check-target-m2zz9\" (UID: \"202249b4-4a9b-4118-94d8-a63381d5d0cd\") " pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.911999 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63-tmp-dir\") pod \"node-resolver-pw76s\" (UID: \"d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63\") " pod="openshift-dns/node-resolver-pw76s" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-sysctl-conf\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912025 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-var-lib-kubelet\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-etc-kubernetes\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-etc-kubernetes\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-run-netns\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bfa1f9c-5189-4fb5-878b-33c9a863b692-tmp\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64239ea5-bafa-4f7c-a183-232428d1c219-konnectivity-ca\") pod \"konnectivity-agent-mcnhd\" (UID: \"64239ea5-bafa-4f7c-a183-232428d1c219\") " pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-run\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-run-netns\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-cnibin\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912206 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-run\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-cnibin\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgg9s\" (UniqueName: \"kubernetes.io/projected/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-kube-api-access-fgg9s\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-systemd\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-sys\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2mvw\" (UniqueName: \"kubernetes.io/projected/d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63-kube-api-access-c2mvw\") pod \"node-resolver-pw76s\" (UID: \"d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63\") " pod="openshift-dns/node-resolver-pw76s" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-lib-modules\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-host\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912435 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63-tmp-dir\") pod \"node-resolver-pw76s\" (UID: \"d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63\") " pod="openshift-dns/node-resolver-pw76s" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64239ea5-bafa-4f7c-a183-232428d1c219-agent-certs\") pod \"konnectivity-agent-mcnhd\" (UID: \"64239ea5-bafa-4f7c-a183-232428d1c219\") " pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912487 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-os-release\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-daemon-config\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-cni-binary-copy\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-socket-dir-parent\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.912992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-systemd\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-hostroot\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-run-multus-certs\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912657 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-sys\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912661 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-os-release\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-var-lib-kubelet\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912781 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cc9010f-e635-417d-8648-16996ea61a8d-dbus\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912791 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-lib-modules\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63-hosts-file\") pod \"node-resolver-pw76s\" (UID: \"d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63\") " pod="openshift-dns/node-resolver-pw76s" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-cni-dir\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64239ea5-bafa-4f7c-a183-232428d1c219-konnectivity-ca\") pod \"konnectivity-agent-mcnhd\" (UID: \"64239ea5-bafa-4f7c-a183-232428d1c219\") " pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912858 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-socket-dir-parent\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-var-lib-cni-bin\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912895 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-var-lib-cni-bin\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shr2d\" (UniqueName: \"kubernetes.io/projected/4bfa1f9c-5189-4fb5-878b-33c9a863b692-kube-api-access-shr2d\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912929 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-host-run-multus-certs\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.913868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cc9010f-e635-417d-8648-16996ea61a8d-kubelet-config\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.912968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-hostroot\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.913007 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cc9010f-e635-417d-8648-16996ea61a8d-kubelet-config\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.913020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-host\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:34.913025 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.913067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bfa1f9c-5189-4fb5-878b-33c9a863b692-var-lib-kubelet\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:34.913112 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs podName:4bd39616-fa08-4d64-975d-b9bb523de55f nodeName:}" failed. No retries permitted until 2026-06-07 19:29:35.413069076 +0000 UTC m=+3.088093977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs") pod "network-metrics-daemon-mdddh" (UID: "4bd39616-fa08-4d64-975d-b9bb523de55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.913160 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cc9010f-e635-417d-8648-16996ea61a8d-dbus\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.913217 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63-hosts-file\") pod \"node-resolver-pw76s\" (UID: \"d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63\") " pod="openshift-dns/node-resolver-pw76s" Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.913255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-cni-dir\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:34.913288 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:34.913344 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret podName:1cc9010f-e635-417d-8648-16996ea61a8d nodeName:}" failed. No retries permitted until 2026-06-07 19:29:35.413327645 +0000 UTC m=+3.088352521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret") pod "global-pull-secret-syncer-7d8dl" (UID: "1cc9010f-e635-417d-8648-16996ea61a8d") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.913369 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-cni-binary-copy\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.913729 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-multus-daemon-config\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.914346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bfa1f9c-5189-4fb5-878b-33c9a863b692-etc-tuned\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.914736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.914425 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bfa1f9c-5189-4fb5-878b-33c9a863b692-tmp\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.915313 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.915295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64239ea5-bafa-4f7c-a183-232428d1c219-agent-certs\") pod \"konnectivity-agent-mcnhd\" (UID: \"64239ea5-bafa-4f7c-a183-232428d1c219\") " pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:34.917370 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:34.917351 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:29:34.917496 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:34.917376 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:29:34.917496 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:34.917390 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mr9b8 for pod openshift-network-diagnostics/network-check-target-m2zz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:34.917496 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:34.917474 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8 podName:202249b4-4a9b-4118-94d8-a63381d5d0cd nodeName:}" failed. No retries permitted until 2026-06-07 19:29:35.417457357 +0000 UTC m=+3.092482250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mr9b8" (UniqueName: "kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8") pod "network-check-target-m2zz9" (UID: "202249b4-4a9b-4118-94d8-a63381d5d0cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:34.919543 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.919524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crfrc\" (UniqueName: \"kubernetes.io/projected/4bd39616-fa08-4d64-975d-b9bb523de55f-kube-api-access-crfrc\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:34.919805 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.919786 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2mvw\" (UniqueName: \"kubernetes.io/projected/d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63-kube-api-access-c2mvw\") pod \"node-resolver-pw76s\" (UID: \"d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63\") " pod="openshift-dns/node-resolver-pw76s" Jun 07 19:29:34.919867 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.919807 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgg9s\" (UniqueName: \"kubernetes.io/projected/bef8be33-a2f1-4616-93a4-e5a4f7c36a7a-kube-api-access-fgg9s\") pod \"multus-rx555\" (UID: \"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a\") " pod="openshift-multus/multus-rx555" Jun 07 19:29:34.927211 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.927165 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shr2d\" (UniqueName: \"kubernetes.io/projected/4bfa1f9c-5189-4fb5-878b-33c9a863b692-kube-api-access-shr2d\") pod \"tuned-fcd6x\" (UID: \"4bfa1f9c-5189-4fb5-878b-33c9a863b692\") " pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:34.998542 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:34.998513 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" Jun 07 19:29:35.006244 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.006220 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kbbdj" Jun 07 19:29:35.016203 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.016183 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:35.021889 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.021870 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" Jun 07 19:29:35.029303 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.029280 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gf466" Jun 07 19:29:35.036852 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.036833 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" Jun 07 19:29:35.043398 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.043380 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:35.049011 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.048996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pw76s" Jun 07 19:29:35.054585 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.054566 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rx555" Jun 07 19:29:35.417177 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.417102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:35.417177 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.417136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:35.417365 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:35.417262 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:35.417365 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:35.417313 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs podName:4bd39616-fa08-4d64-975d-b9bb523de55f nodeName:}" failed. No retries permitted until 2026-06-07 19:29:36.417299106 +0000 UTC m=+4.092323982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs") pod "network-metrics-daemon-mdddh" (UID: "4bd39616-fa08-4d64-975d-b9bb523de55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:35.417365 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:35.417265 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:35.417511 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:35.417404 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret podName:1cc9010f-e635-417d-8648-16996ea61a8d nodeName:}" failed. No retries permitted until 2026-06-07 19:29:36.417383678 +0000 UTC m=+4.092408560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret") pod "global-pull-secret-syncer-7d8dl" (UID: "1cc9010f-e635-417d-8648-16996ea61a8d") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:35.518486 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.518408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9b8\" (UniqueName: \"kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8\") pod \"network-check-target-m2zz9\" (UID: \"202249b4-4a9b-4118-94d8-a63381d5d0cd\") " pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:35.518657 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:35.518594 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:29:35.518657 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:35.518618 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:29:35.518657 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:35.518631 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mr9b8 for pod openshift-network-diagnostics/network-check-target-m2zz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:35.518836 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:35.518693 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8 podName:202249b4-4a9b-4118-94d8-a63381d5d0cd nodeName:}" failed. No retries permitted until 2026-06-07 19:29:36.518677762 +0000 UTC m=+4.193702660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mr9b8" (UniqueName: "kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8") pod "network-check-target-m2zz9" (UID: "202249b4-4a9b-4118-94d8-a63381d5d0cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:35.612051 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:35.612022 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25038978_89b5_4e4f_a340_26505aabda95.slice/crio-eea495bd2a958867a0255603542be8e7e14e71615402b3fe54676ce3930ed5aa WatchSource:0}: Error finding container eea495bd2a958867a0255603542be8e7e14e71615402b3fe54676ce3930ed5aa: Status 404 returned error can't find the container with id eea495bd2a958867a0255603542be8e7e14e71615402b3fe54676ce3930ed5aa Jun 07 19:29:35.613034 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:35.613007 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e27e88_bd37_4ece_9dc6_97e3c1bd3b63.slice/crio-bb0a133e1540f54ecc4ab8e363efe33e31b4590a24497229fb92f7ddb2ca9d72 WatchSource:0}: Error finding container bb0a133e1540f54ecc4ab8e363efe33e31b4590a24497229fb92f7ddb2ca9d72: Status 404 returned error can't find the container with id bb0a133e1540f54ecc4ab8e363efe33e31b4590a24497229fb92f7ddb2ca9d72 Jun 07 19:29:35.613819 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:35.613747 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808ddad5_35a8_4725_abaf_14ba7e9d3bc8.slice/crio-1e2cae788d2faa3bb9817936b9461ee7986ab0a230426eefe03c1fe5bfaf89d0 WatchSource:0}: Error finding container 1e2cae788d2faa3bb9817936b9461ee7986ab0a230426eefe03c1fe5bfaf89d0: Status 404 returned error can't find the container with id 1e2cae788d2faa3bb9817936b9461ee7986ab0a230426eefe03c1fe5bfaf89d0 Jun 07 19:29:35.616208 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:35.616175 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64239ea5_bafa_4f7c_a183_232428d1c219.slice/crio-adaab4e8c8a927cd5d8914f35ebcf68c7662ceb23d3a5fd14f3830c772a5ac27 WatchSource:0}: Error finding container adaab4e8c8a927cd5d8914f35ebcf68c7662ceb23d3a5fd14f3830c772a5ac27: Status 404 returned error can't find the container with id adaab4e8c8a927cd5d8914f35ebcf68c7662ceb23d3a5fd14f3830c772a5ac27 Jun 07 19:29:35.618858 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:35.618837 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee17169b_0931_4861_97d5_84510bf566a3.slice/crio-df7345130fd4525164f22e414d27a9386809f481836c55fc13c761dbfaf7b9d2 WatchSource:0}: Error finding container df7345130fd4525164f22e414d27a9386809f481836c55fc13c761dbfaf7b9d2: Status 404 returned error can't find the container with id df7345130fd4525164f22e414d27a9386809f481836c55fc13c761dbfaf7b9d2 Jun 07 19:29:35.639663 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:35.639641 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf9750f_6777_4212_88b5_68ea78e99972.slice/crio-121d46daa5044e2db53b4eef40d4a808921855d584248841c1d1a6424b5fac89 WatchSource:0}: Error finding container 121d46daa5044e2db53b4eef40d4a808921855d584248841c1d1a6424b5fac89: Status 404 returned error can't find the container with id 121d46daa5044e2db53b4eef40d4a808921855d584248841c1d1a6424b5fac89 Jun 07 19:29:35.641281 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:35.641178 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef8be33_a2f1_4616_93a4_e5a4f7c36a7a.slice/crio-ac5efbbdbd2d293371101453569a64f936a68c697d5fdcd774f79b5eeaaa85c2 WatchSource:0}: Error finding container ac5efbbdbd2d293371101453569a64f936a68c697d5fdcd774f79b5eeaaa85c2: Status 404 returned error can't find the container with id ac5efbbdbd2d293371101453569a64f936a68c697d5fdcd774f79b5eeaaa85c2 Jun 07 19:29:35.642268 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:35.642246 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fc3522_740a_4477_8591_8d650ac06837.slice/crio-83badc85ea65cb56311a78d5a5f1ff0c72877fba2afbdac5e56b142cc6b37e60 WatchSource:0}: Error finding container 83badc85ea65cb56311a78d5a5f1ff0c72877fba2afbdac5e56b142cc6b37e60: Status 404 returned error can't find the container with id 83badc85ea65cb56311a78d5a5f1ff0c72877fba2afbdac5e56b142cc6b37e60 Jun 07 19:29:35.642971 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:29:35.642953 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bfa1f9c_5189_4fb5_878b_33c9a863b692.slice/crio-d823b510c8632eec704613efe0f1a6d1c8c2cbc83f99da5b529fedc16a05904f WatchSource:0}: Error finding container d823b510c8632eec704613efe0f1a6d1c8c2cbc83f99da5b529fedc16a05904f: Status 404 returned error can't find the container with id d823b510c8632eec704613efe0f1a6d1c8c2cbc83f99da5b529fedc16a05904f Jun 07 19:29:35.740430 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.740244 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 19:24:34 +0000 UTC" deadline="2027-12-05 23:37:28.970888565 +0000 UTC" Jun 07 19:29:35.740430 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.740429 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13108h7m53.230465319s" Jun 07 19:29:35.754694 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.754673 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:35.754788 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:35.754769 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:35.766918 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.766889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" event={"ID":"3a8c5dee304fa10b5807d1a06407eb73","Type":"ContainerStarted","Data":"173726495b24b2d81ccb01a3afd341a523e2ed159832ec206f6cb013f60a3721"} Jun 07 19:29:35.770182 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.770154 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" event={"ID":"4bfa1f9c-5189-4fb5-878b-33c9a863b692","Type":"ContainerStarted","Data":"d823b510c8632eec704613efe0f1a6d1c8c2cbc83f99da5b529fedc16a05904f"} Jun 07 19:29:35.772457 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.772437 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rx555" event={"ID":"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a","Type":"ContainerStarted","Data":"ac5efbbdbd2d293371101453569a64f936a68c697d5fdcd774f79b5eeaaa85c2"} Jun 07 19:29:35.777021 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.776991 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" event={"ID":"ee17169b-0931-4861-97d5-84510bf566a3","Type":"ContainerStarted","Data":"df7345130fd4525164f22e414d27a9386809f481836c55fc13c761dbfaf7b9d2"} Jun 07 19:29:35.777981 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.777950 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mcnhd" event={"ID":"64239ea5-bafa-4f7c-a183-232428d1c219","Type":"ContainerStarted","Data":"adaab4e8c8a927cd5d8914f35ebcf68c7662ceb23d3a5fd14f3830c772a5ac27"} Jun 07 19:29:35.778985 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.778967 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" event={"ID":"808ddad5-35a8-4725-abaf-14ba7e9d3bc8","Type":"ContainerStarted","Data":"1e2cae788d2faa3bb9817936b9461ee7986ab0a230426eefe03c1fe5bfaf89d0"} Jun 07 19:29:35.779632 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.779595 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" podStartSLOduration=1.779584588 podStartE2EDuration="1.779584588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:29:35.779372954 +0000 UTC m=+3.454397852" watchObservedRunningTime="2026-06-07 19:29:35.779584588 +0000 UTC m=+3.454609486" Jun 07 19:29:35.780407 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.780388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gf466" event={"ID":"25038978-89b5-4e4f-a340-26505aabda95","Type":"ContainerStarted","Data":"eea495bd2a958867a0255603542be8e7e14e71615402b3fe54676ce3930ed5aa"} Jun 07 19:29:35.783339 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.783319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" event={"ID":"caf9750f-6777-4212-88b5-68ea78e99972","Type":"ContainerStarted","Data":"121d46daa5044e2db53b4eef40d4a808921855d584248841c1d1a6424b5fac89"} Jun 07 19:29:35.785892 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.785875 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kbbdj" event={"ID":"d3fc3522-740a-4477-8591-8d650ac06837","Type":"ContainerStarted","Data":"83badc85ea65cb56311a78d5a5f1ff0c72877fba2afbdac5e56b142cc6b37e60"} Jun 07 19:29:35.786800 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:35.786783 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pw76s" event={"ID":"d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63","Type":"ContainerStarted","Data":"bb0a133e1540f54ecc4ab8e363efe33e31b4590a24497229fb92f7ddb2ca9d72"} Jun 07 19:29:36.425395 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:36.424505 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:36.425395 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:36.424592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:36.425395 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:36.424771 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:36.425395 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:36.424837 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs podName:4bd39616-fa08-4d64-975d-b9bb523de55f nodeName:}" failed. No retries permitted until 2026-06-07 19:29:38.424816369 +0000 UTC m=+6.099841262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs") pod "network-metrics-daemon-mdddh" (UID: "4bd39616-fa08-4d64-975d-b9bb523de55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:36.425395 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:36.425239 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:36.425395 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:36.425291 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret podName:1cc9010f-e635-417d-8648-16996ea61a8d nodeName:}" failed. No retries permitted until 2026-06-07 19:29:38.425275745 +0000 UTC m=+6.100300626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret") pod "global-pull-secret-syncer-7d8dl" (UID: "1cc9010f-e635-417d-8648-16996ea61a8d") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:36.525430 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:36.525378 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9b8\" (UniqueName: \"kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8\") pod \"network-check-target-m2zz9\" (UID: \"202249b4-4a9b-4118-94d8-a63381d5d0cd\") " pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:36.525647 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:36.525622 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:29:36.525647 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:36.525646 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:29:36.525776 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:36.525659 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mr9b8 for pod openshift-network-diagnostics/network-check-target-m2zz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:36.525776 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:36.525720 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8 podName:202249b4-4a9b-4118-94d8-a63381d5d0cd nodeName:}" failed. No retries permitted until 2026-06-07 19:29:38.525697748 +0000 UTC m=+6.200722628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mr9b8" (UniqueName: "kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8") pod "network-check-target-m2zz9" (UID: "202249b4-4a9b-4118-94d8-a63381d5d0cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:36.589465 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:36.588648 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 19:29:36.741327 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:36.741237 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 19:24:34 +0000 UTC" deadline="2027-12-15 17:33:34.361688973 +0000 UTC" Jun 07 19:29:36.741327 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:36.741277 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13342h3m57.620416043s" Jun 07 19:29:36.756727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:36.755724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:36.756727 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:36.755955 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:36.756727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:36.756548 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:36.756727 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:36.756687 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:36.821626 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:36.820740 2562 generic.go:356] "Generic (PLEG): container finished" podID="acfcef4dd4d5a3f67551d8b6c9d7a22b" containerID="543a1520e16307d4d0f1b2ff5b6a0b07ecd6d2a9a07de4e06ae2aee03a36cb36" exitCode=0 Jun 07 19:29:36.821626 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:36.821566 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"acfcef4dd4d5a3f67551d8b6c9d7a22b","Type":"ContainerDied","Data":"543a1520e16307d4d0f1b2ff5b6a0b07ecd6d2a9a07de4e06ae2aee03a36cb36"} Jun 07 19:29:37.755457 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:37.754541 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:37.755457 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:37.754679 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:37.851302 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:37.851234 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"acfcef4dd4d5a3f67551d8b6c9d7a22b","Type":"ContainerStarted","Data":"2509d11e3a8add2fd3c8de7731982c1094ef31c8716f981a51cf7457b53926a8"} Jun 07 19:29:37.864980 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:37.864921 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" podStartSLOduration=3.864900888 podStartE2EDuration="3.864900888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:29:37.864708045 +0000 UTC m=+5.539732944" watchObservedRunningTime="2026-06-07 19:29:37.864900888 +0000 UTC m=+5.539925786" Jun 07 19:29:38.440348 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:38.440301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:38.440546 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:38.440357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:38.440546 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:38.440498 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:38.440546 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:38.440524 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:38.440715 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:38.440572 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret podName:1cc9010f-e635-417d-8648-16996ea61a8d nodeName:}" failed. No retries permitted until 2026-06-07 19:29:42.440551945 +0000 UTC m=+10.115576837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret") pod "global-pull-secret-syncer-7d8dl" (UID: "1cc9010f-e635-417d-8648-16996ea61a8d") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:38.440715 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:38.440594 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs podName:4bd39616-fa08-4d64-975d-b9bb523de55f nodeName:}" failed. No retries permitted until 2026-06-07 19:29:42.440583684 +0000 UTC m=+10.115608562 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs") pod "network-metrics-daemon-mdddh" (UID: "4bd39616-fa08-4d64-975d-b9bb523de55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:38.541311 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:38.541263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9b8\" (UniqueName: \"kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8\") pod \"network-check-target-m2zz9\" (UID: \"202249b4-4a9b-4118-94d8-a63381d5d0cd\") " pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:38.541515 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:38.541498 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:29:38.541585 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:38.541523 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:29:38.541585 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:38.541535 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mr9b8 for pod openshift-network-diagnostics/network-check-target-m2zz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:38.541585 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:38.541594 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8 podName:202249b4-4a9b-4118-94d8-a63381d5d0cd nodeName:}" failed. No retries permitted until 2026-06-07 19:29:42.541576191 +0000 UTC m=+10.216601087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mr9b8" (UniqueName: "kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8") pod "network-check-target-m2zz9" (UID: "202249b4-4a9b-4118-94d8-a63381d5d0cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:38.755586 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:38.755506 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:38.756023 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:38.755632 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:38.756083 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:38.756052 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:38.756167 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:38.756145 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:39.754864 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:39.754813 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:39.755047 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:39.754955 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:40.754349 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:40.754319 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:40.754772 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:40.754468 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:40.754772 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:40.754511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:40.754772 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:40.754611 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:41.755100 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:41.755057 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:41.755649 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:41.755197 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:42.476628 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:42.475599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:42.476628 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:42.475650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:42.476628 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:42.475813 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:42.476628 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:42.475878 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs podName:4bd39616-fa08-4d64-975d-b9bb523de55f nodeName:}" failed. No retries permitted until 2026-06-07 19:29:50.475858233 +0000 UTC m=+18.150883125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs") pod "network-metrics-daemon-mdddh" (UID: "4bd39616-fa08-4d64-975d-b9bb523de55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:42.476628 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:42.476277 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:42.476628 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:42.476332 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret podName:1cc9010f-e635-417d-8648-16996ea61a8d nodeName:}" failed. No retries permitted until 2026-06-07 19:29:50.476315247 +0000 UTC m=+18.151340127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret") pod "global-pull-secret-syncer-7d8dl" (UID: "1cc9010f-e635-417d-8648-16996ea61a8d") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:42.576315 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:42.576276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9b8\" (UniqueName: \"kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8\") pod \"network-check-target-m2zz9\" (UID: \"202249b4-4a9b-4118-94d8-a63381d5d0cd\") " pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:42.576516 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:42.576494 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:29:42.576584 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:42.576518 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:29:42.576584 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:42.576531 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mr9b8 for pod openshift-network-diagnostics/network-check-target-m2zz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:42.576689 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:42.576592 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8 podName:202249b4-4a9b-4118-94d8-a63381d5d0cd nodeName:}" failed. No retries permitted until 2026-06-07 19:29:50.576573648 +0000 UTC m=+18.251598539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mr9b8" (UniqueName: "kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8") pod "network-check-target-m2zz9" (UID: "202249b4-4a9b-4118-94d8-a63381d5d0cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:42.755217 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:42.755146 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:42.756098 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:42.755747 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:42.756208 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:42.756134 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:42.756273 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:42.756245 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:43.755371 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:43.754866 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:43.755371 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:43.755011 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:44.754907 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:44.754871 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:44.755085 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:44.755004 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:44.755516 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:44.755310 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:44.755516 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:44.755471 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:45.754870 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:45.754836 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:45.755035 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:45.754967 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:46.754845 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:46.754815 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:46.755213 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:46.754826 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:46.755213 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:46.754954 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:46.755213 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:46.754988 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:47.754452 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:47.754406 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:47.754684 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:47.754562 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:48.754044 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:48.754008 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:48.754545 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:48.754133 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:48.754545 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:48.754136 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:48.754545 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:48.754202 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:49.754431 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:49.754383 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:49.754799 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:49.754505 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:50.534812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:50.534761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:50.534812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:50.534812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:50.535056 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:50.534910 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:50.535056 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:50.534914 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:50.535056 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:50.534973 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs podName:4bd39616-fa08-4d64-975d-b9bb523de55f nodeName:}" failed. No retries permitted until 2026-06-07 19:30:06.5349579 +0000 UTC m=+34.209982776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs") pod "network-metrics-daemon-mdddh" (UID: "4bd39616-fa08-4d64-975d-b9bb523de55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:29:50.535056 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:50.534990 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret podName:1cc9010f-e635-417d-8648-16996ea61a8d nodeName:}" failed. No retries permitted until 2026-06-07 19:30:06.534981473 +0000 UTC m=+34.210006354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret") pod "global-pull-secret-syncer-7d8dl" (UID: "1cc9010f-e635-417d-8648-16996ea61a8d") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:29:50.635994 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:50.635960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9b8\" (UniqueName: \"kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8\") pod \"network-check-target-m2zz9\" (UID: \"202249b4-4a9b-4118-94d8-a63381d5d0cd\") " pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:50.636171 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:50.636097 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:29:50.636171 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:50.636121 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:29:50.636171 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:50.636133 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mr9b8 for pod openshift-network-diagnostics/network-check-target-m2zz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:50.636311 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:50.636195 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8 podName:202249b4-4a9b-4118-94d8-a63381d5d0cd nodeName:}" failed. No retries permitted until 2026-06-07 19:30:06.636176331 +0000 UTC m=+34.311201211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mr9b8" (UniqueName: "kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8") pod "network-check-target-m2zz9" (UID: "202249b4-4a9b-4118-94d8-a63381d5d0cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:29:50.754087 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:50.754053 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:50.754248 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:50.754189 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:50.754308 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:50.754243 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:50.754382 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:50.754360 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:51.754736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:51.754703 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:51.755176 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:51.754818 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:52.755835 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:52.755741 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:52.756231 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:52.755876 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:52.756231 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:52.755924 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:52.756231 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:52.756044 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:53.754864 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:53.754830 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:53.755052 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:53.754972 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:54.754538 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.754085 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:54.755331 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.754094 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:54.755331 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:54.754647 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:54.755331 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:54.754700 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:54.885082 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.885003 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rx555" event={"ID":"bef8be33-a2f1-4616-93a4-e5a4f7c36a7a","Type":"ContainerStarted","Data":"f8797b25e828d28386672cbf4775780e4e38ed10a66eb3dbffd1af99b093f1f7"} Jun 07 19:29:54.886637 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.886609 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee17169b-0931-4861-97d5-84510bf566a3" containerID="96aa4994c6e425e561c0a3d59b942ac5258c2f9ce8ce6c024aed560fe0ff84df" exitCode=0 Jun 07 19:29:54.886992 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.886952 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" event={"ID":"ee17169b-0931-4861-97d5-84510bf566a3","Type":"ContainerDied","Data":"96aa4994c6e425e561c0a3d59b942ac5258c2f9ce8ce6c024aed560fe0ff84df"} Jun 07 19:29:54.891469 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.891445 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mcnhd" event={"ID":"64239ea5-bafa-4f7c-a183-232428d1c219","Type":"ContainerStarted","Data":"6ac10c4eadcd8454af25a43b507ed28ada87573af8b1de0ffef8a2893d7ac3a6"} Jun 07 19:29:54.893018 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.892998 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" event={"ID":"808ddad5-35a8-4725-abaf-14ba7e9d3bc8","Type":"ContainerStarted","Data":"893733ea520aad45801306d58652e8fbc474c64917df9c83cac7a093cd9ea214"} Jun 07 19:29:54.894454 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.894430 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gf466" event={"ID":"25038978-89b5-4e4f-a340-26505aabda95","Type":"ContainerStarted","Data":"3ec73d9a6c673cccd7a97b64d3262dbf94f4b3e282f047450282b7a45e5edf57"} Jun 07 19:29:54.897150 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.897133 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:29:54.897478 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.897452 2562 generic.go:356] "Generic (PLEG): container finished" podID="caf9750f-6777-4212-88b5-68ea78e99972" containerID="d2cf0a5fe952c2533d697aea94492aa329be167b896293e9e264ad4553334639" exitCode=1 Jun 07 19:29:54.897569 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.897522 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" event={"ID":"caf9750f-6777-4212-88b5-68ea78e99972","Type":"ContainerStarted","Data":"d652fb3e65e47ddbd6433914d34ae0e5b315d75faac6b7b4064c795395c2cda0"} Jun 07 19:29:54.897666 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.897593 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" event={"ID":"caf9750f-6777-4212-88b5-68ea78e99972","Type":"ContainerStarted","Data":"2902a59a34b4dadac6590af092cf28d54960c7c676bd45768523ebe68d881e31"} Jun 07 19:29:54.897666 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.897643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" event={"ID":"caf9750f-6777-4212-88b5-68ea78e99972","Type":"ContainerStarted","Data":"0f0c22c1aedc8852aa896063f202fdaa5aa5c48250752f7303920501ca653a56"} Jun 07 19:29:54.897792 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.897690 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" event={"ID":"caf9750f-6777-4212-88b5-68ea78e99972","Type":"ContainerStarted","Data":"9c7aa33b1822fe7797b69c66d0c54ef3970027f6c6e2246311c4a2be84954405"} Jun 07 19:29:54.897792 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.897739 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" event={"ID":"caf9750f-6777-4212-88b5-68ea78e99972","Type":"ContainerDied","Data":"d2cf0a5fe952c2533d697aea94492aa329be167b896293e9e264ad4553334639"} Jun 07 19:29:54.897890 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.897797 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" event={"ID":"caf9750f-6777-4212-88b5-68ea78e99972","Type":"ContainerStarted","Data":"df78aee2ad10521b1787d06e2cb0a994674d12bffb8db21e11fc97b61183a4f2"} Jun 07 19:29:54.898903 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.898881 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pw76s" event={"ID":"d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63","Type":"ContainerStarted","Data":"30bb92b3419e6d03035b976e0cc18f634d1428916a27bbc4eb1c9190130957d1"} Jun 07 19:29:54.900360 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.900338 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" event={"ID":"4bfa1f9c-5189-4fb5-878b-33c9a863b692","Type":"ContainerStarted","Data":"75df428b141047e7efceef631691a3d925413e89b33030e716488bb190a8250e"} Jun 07 19:29:54.904038 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.904004 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rx555" podStartSLOduration=4.438759902 podStartE2EDuration="22.903993537s" totalImagesPullingTime="18.465233635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:29:54.903585455 +0000 UTC m=+22.578610353" watchObservedRunningTime="2026-06-07 19:29:54.903993537 +0000 UTC m=+22.579018435" Jun 07 19:29:54.938999 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.938950 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gf466" podStartSLOduration=4.498017879 podStartE2EDuration="22.938935593s" totalImagesPullingTime="18.440917714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:29:54.938641463 +0000 UTC m=+22.613666362" watchObservedRunningTime="2026-06-07 19:29:54.938935593 +0000 UTC m=+22.613960554" Jun 07 19:29:54.953225 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.953179 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pw76s" podStartSLOduration=4.513073144 podStartE2EDuration="22.953166031s" totalImagesPullingTime="18.440092887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:29:54.952581828 +0000 UTC m=+22.627606726" watchObservedRunningTime="2026-06-07 19:29:54.953166031 +0000 UTC m=+22.628190929" Jun 07 19:29:54.971645 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.971593 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fcd6x" podStartSLOduration=4.557205013 podStartE2EDuration="22.971576836s" totalImagesPullingTime="18.414371823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:29:54.971316998 +0000 UTC m=+22.646341899" watchObservedRunningTime="2026-06-07 19:29:54.971576836 +0000 UTC m=+22.646601734" Jun 07 19:29:54.986108 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:54.986064 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mcnhd" podStartSLOduration=12.561664729 podStartE2EDuration="22.986043581s" totalImagesPullingTime="10.424378852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:29:54.985807026 +0000 UTC m=+22.660831906" watchObservedRunningTime="2026-06-07 19:29:54.986043581 +0000 UTC m=+22.661068479" Jun 07 19:29:55.036207 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.036164 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:55.093749 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.093710 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:55.144599 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.144528 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:55.191874 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.191843 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:55.367623 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.367594 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:55.391520 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.391501 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gf466_25038978-89b5-4e4f-a340-26505aabda95/node-ca/0.log" Jun 07 19:29:55.469736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.469637 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:55.569225 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.569187 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:55.624827 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.624795 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 07 19:29:55.669834 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.669802 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:55.754133 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.754056 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:55.754279 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:55.754179 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:55.761655 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.761526 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-07T19:29:55.624824336Z","UUID":"c6b71e7a-2d26-4a94-8492-762db839c969","Handler":null,"Name":"","Endpoint":""} Jun 07 19:29:55.763203 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.763183 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 07 19:29:55.763330 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.763219 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 07 19:29:55.904565 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.904530 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" event={"ID":"808ddad5-35a8-4725-abaf-14ba7e9d3bc8","Type":"ContainerStarted","Data":"a161eb7bd4bda9db7ebbf0ad83c16d033ee9276496d554c367b3571e61d10d8e"} Jun 07 19:29:55.906145 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.906088 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kbbdj" event={"ID":"d3fc3522-740a-4477-8591-8d650ac06837","Type":"ContainerStarted","Data":"dac1c5974969c2928bab5bbd6e34af0061ee6da4ece0f4b9f4f0deed21c9bcda"} Jun 07 19:29:55.923098 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.923042 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kbbdj" podStartSLOduration=5.514553454 podStartE2EDuration="23.923023324s" totalImagesPullingTime="18.40846987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:29:55.922493132 +0000 UTC m=+23.597518030" watchObservedRunningTime="2026-06-07 19:29:55.923023324 +0000 UTC m=+23.598048225" Jun 07 19:29:55.944871 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:55.944836 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:56.629532 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:56.629498 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:56.754370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:56.754340 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:56.754555 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:56.754498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:56.754555 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:56.754522 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:56.754673 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:56.754626 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:56.803097 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:56.803065 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:56.910836 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:56.910675 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" event={"ID":"808ddad5-35a8-4725-abaf-14ba7e9d3bc8","Type":"ContainerStarted","Data":"861e1d70c6217ecc0b49f7b70384e7a0611b50be0a99d0fce1f4afff839267d5"} Jun 07 19:29:56.920138 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:56.920086 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:56.948129 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:56.948078 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghkxv" podStartSLOduration=4.344596263 podStartE2EDuration="24.948057079s" totalImagesPullingTime="20.603460816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:29:56.947658183 +0000 UTC m=+24.622683081" watchObservedRunningTime="2026-06-07 19:29:56.948057079 +0000 UTC m=+24.623081978" Jun 07 19:29:57.008513 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:57.008480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:57.105575 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:57.105540 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:57.477962 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:57.477919 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:57.721993 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:57.721941 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:57.754923 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:57.754861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:57.755077 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:57.755000 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:57.916105 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:57.916080 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:29:57.916567 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:57.916487 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" event={"ID":"caf9750f-6777-4212-88b5-68ea78e99972","Type":"ContainerStarted","Data":"c4c4a329e30a2d327149c86f9dae33b39ff8e8b6d88d75a0b0303bebf88102df"} Jun 07 19:29:58.120752 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:58.120670 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:58.354453 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:58.354401 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:58.355100 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:58.355073 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:58.480747 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:58.480661 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:58.529571 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:58.529532 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:58.668181 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:58.668149 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:58.668662 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:58.668632 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mcnhd" Jun 07 19:29:58.727142 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:58.727109 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:58.754140 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:58.754056 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:29:58.754140 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:58.754073 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:29:58.754387 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:58.754187 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:29:58.754387 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:58.754333 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:29:59.123704 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.123669 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:59.724355 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.724152 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:29:59.754996 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.754970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:29:59.755126 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:29:59.755069 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:29:59.922299 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.922270 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee17169b-0931-4861-97d5-84510bf566a3" containerID="ac867e4eb76b6a9787421e5d40e6ff35165d8291a0029da87046a26f9f217698" exitCode=0 Jun 07 19:29:59.922497 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.922355 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" event={"ID":"ee17169b-0931-4861-97d5-84510bf566a3","Type":"ContainerDied","Data":"ac867e4eb76b6a9787421e5d40e6ff35165d8291a0029da87046a26f9f217698"} Jun 07 19:29:59.925924 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.925907 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:29:59.926310 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.926287 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" event={"ID":"caf9750f-6777-4212-88b5-68ea78e99972","Type":"ContainerStarted","Data":"99e9d8802097effee6295165079601e3affd97546328344de0f49c5203c07001"} Jun 07 19:29:59.926611 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.926591 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:59.926726 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.926661 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:59.926785 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.926751 2562 scope.go:117] "RemoveContainer" containerID="d2cf0a5fe952c2533d697aea94492aa329be167b896293e9e264ad4553334639" Jun 07 19:29:59.941985 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.941964 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:29:59.942082 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:29:59.942057 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:30:00.319040 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:00.318964 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:00.419151 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:00.419112 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:00.428730 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:00.428708 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:30:00.523304 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:00.523275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:00.721910 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:00.721832 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:00.754691 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:00.754666 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:00.754691 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:00.754683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:00.754859 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:00.754761 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:30:00.754906 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:00.754876 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:30:00.931622 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:00.931596 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:30:00.931948 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:00.931928 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" event={"ID":"caf9750f-6777-4212-88b5-68ea78e99972","Type":"ContainerStarted","Data":"eb961ac8aa7b7c26298e719e5992b7ffffece5f3ee0ab17d757fc8f05a1eb6b3"} Jun 07 19:30:00.955004 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:00.954963 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" podStartSLOduration=10.463660876 podStartE2EDuration="28.954949402s" totalImagesPullingTime="18.491288526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:00.953799143 +0000 UTC m=+28.628824040" watchObservedRunningTime="2026-06-07 19:30:00.954949402 +0000 UTC m=+28.629974300" Jun 07 19:30:01.122808 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:01.122776 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:01.223573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:01.223542 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:01.720662 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:01.720625 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:01.754102 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:01.754079 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:01.754227 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:01.754182 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:30:01.936382 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:01.936346 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee17169b-0931-4861-97d5-84510bf566a3" containerID="69991eb796faadcb882478d742ad51562ec5b16cfbfa56ac239321c3b14f7526" exitCode=0 Jun 07 19:30:01.936554 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:01.936387 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" event={"ID":"ee17169b-0931-4861-97d5-84510bf566a3","Type":"ContainerDied","Data":"69991eb796faadcb882478d742ad51562ec5b16cfbfa56ac239321c3b14f7526"} Jun 07 19:30:02.122759 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:02.122683 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:02.225927 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:02.225893 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:02.325380 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:02.325350 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:02.422641 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:02.422552 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:02.478343 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:02.478312 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:02.531668 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:02.531640 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:02.649825 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:02.649788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:02.751486 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:02.751350 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:02.755159 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:02.755139 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:02.755300 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:02.755241 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:30:02.755300 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:02.755286 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:02.755428 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:02.755382 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:30:02.900303 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:02.900268 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:03.072984 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:03.072903 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:03.174672 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:03.174640 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:03.490225 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:03.490144 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:03.585473 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:03.585431 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:03.710396 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:03.710357 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:03.754488 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:03.754430 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:03.754811 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:03.754536 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:30:03.759535 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:03.759514 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:03.918585 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:03.918553 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:03.943348 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:03.943314 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee17169b-0931-4861-97d5-84510bf566a3" containerID="b4125c9d5b4e7bb78687c2aafa4b2a9bb9398cb194c40b93e5ab6bfbea520c87" exitCode=0 Jun 07 19:30:03.943515 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:03.943381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" event={"ID":"ee17169b-0931-4861-97d5-84510bf566a3","Type":"ContainerDied","Data":"b4125c9d5b4e7bb78687c2aafa4b2a9bb9398cb194c40b93e5ab6bfbea520c87"} Jun 07 19:30:03.970190 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:03.970158 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:04.090541 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:04.090437 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:04.140810 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:04.140782 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:04.288245 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:04.288192 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:04.553161 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:04.553066 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:04.719390 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:04.719350 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:04.754398 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:04.754368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:04.754578 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:04.754370 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:04.754578 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:04.754517 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:30:04.754578 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:04.754543 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:30:05.319365 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:05.319325 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:05.707278 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:05.707150 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:05.754093 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:05.754060 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:05.754274 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:05.754202 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:30:05.755626 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:05.755598 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:06.119266 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:06.119174 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:06.318749 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:06.318713 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:06.568121 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:06.568086 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:06.568121 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:06.568126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:06.568367 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:06.568227 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:30:06.568367 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:06.568290 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs podName:4bd39616-fa08-4d64-975d-b9bb523de55f nodeName:}" failed. No retries permitted until 2026-06-07 19:30:38.568271596 +0000 UTC m=+66.243296472 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs") pod "network-metrics-daemon-mdddh" (UID: "4bd39616-fa08-4d64-975d-b9bb523de55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:30:06.568367 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:06.568229 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:30:06.568367 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:06.568364 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret podName:1cc9010f-e635-417d-8648-16996ea61a8d nodeName:}" failed. No retries permitted until 2026-06-07 19:30:38.568349184 +0000 UTC m=+66.243374064 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret") pod "global-pull-secret-syncer-7d8dl" (UID: "1cc9010f-e635-417d-8648-16996ea61a8d") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:30:06.668964 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:06.668932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9b8\" (UniqueName: \"kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8\") pod \"network-check-target-m2zz9\" (UID: \"202249b4-4a9b-4118-94d8-a63381d5d0cd\") " pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:06.669143 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:06.669075 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:30:06.669143 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:06.669096 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:30:06.669143 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:06.669108 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mr9b8 for pod openshift-network-diagnostics/network-check-target-m2zz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:30:06.669292 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:06.669169 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8 podName:202249b4-4a9b-4118-94d8-a63381d5d0cd nodeName:}" failed. No retries permitted until 2026-06-07 19:30:38.669149658 +0000 UTC m=+66.344174536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mr9b8" (UniqueName: "kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8") pod "network-check-target-m2zz9" (UID: "202249b4-4a9b-4118-94d8-a63381d5d0cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:30:06.719695 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:06.719660 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:06.754661 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:06.754631 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:06.754843 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:06.754629 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:06.754843 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:06.754763 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:30:06.754843 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:06.754824 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:30:07.317613 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:07.317564 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:07.519354 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:07.519321 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:07.716519 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:07.716408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:07.754463 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:07.754433 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:07.754641 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:07.754547 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:30:07.959090 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:07.959055 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" event={"ID":"ee17169b-0931-4861-97d5-84510bf566a3","Type":"ContainerStarted","Data":"b5d1bcf8c186d8725f75bd56b1ecfdeb33ed364b6d362b69c109dc526f87cc13"} Jun 07 19:30:08.204173 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:08.204142 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:08.427908 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:08.427881 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:08.755178 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:08.755083 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:08.755336 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:08.755185 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:30:08.755336 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:08.755239 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:08.755336 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:08.755321 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:30:08.964360 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:08.964326 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee17169b-0931-4861-97d5-84510bf566a3" containerID="b5d1bcf8c186d8725f75bd56b1ecfdeb33ed364b6d362b69c109dc526f87cc13" exitCode=0 Jun 07 19:30:08.964590 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:08.964382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" event={"ID":"ee17169b-0931-4861-97d5-84510bf566a3","Type":"ContainerDied","Data":"b5d1bcf8c186d8725f75bd56b1ecfdeb33ed364b6d362b69c109dc526f87cc13"} Jun 07 19:30:09.754847 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:09.754809 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:09.755214 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:09.754921 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:30:09.969866 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:09.969831 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee17169b-0931-4861-97d5-84510bf566a3" containerID="e92740ae16af0e270746797dc5998d0380210b165d23d4373d139715eb499869" exitCode=0 Jun 07 19:30:09.969999 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:09.969889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" event={"ID":"ee17169b-0931-4861-97d5-84510bf566a3","Type":"ContainerDied","Data":"e92740ae16af0e270746797dc5998d0380210b165d23d4373d139715eb499869"} Jun 07 19:30:10.087549 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:10.087515 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:10.754068 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:10.754030 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:10.754263 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:10.754134 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:30:10.754263 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:10.754194 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:10.754464 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:10.754304 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:30:10.974972 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:10.974942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" event={"ID":"ee17169b-0931-4861-97d5-84510bf566a3","Type":"ContainerStarted","Data":"0935e73affde625901a376f6694121e2bdc854dac329439954ae8264bc09e26f"} Jun 07 19:30:10.995659 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:10.995616 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7ltqm" podStartSLOduration=10.079830661999999 podStartE2EDuration="38.995604435s" totalImagesPullingTime="28.915773773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:10.994337064 +0000 UTC m=+38.669361972" watchObservedRunningTime="2026-06-07 19:30:10.995604435 +0000 UTC m=+38.670629332" Jun 07 19:30:11.754732 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:11.754698 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:11.754909 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:11.754806 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:30:12.755535 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:12.755501 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:12.755990 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:12.755585 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:30:12.755990 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:12.755658 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:12.755990 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:12.755748 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:30:13.046925 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:13.046895 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:13.755032 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:13.755005 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:13.755198 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:13.755103 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:30:13.784842 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:13.784808 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:13.933310 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:13.933275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:14.035289 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:14.035260 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:14.757560 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:14.757535 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:14.757776 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:14.757536 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:14.757776 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:14.757643 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:30:14.757776 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:14.757708 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:30:15.143692 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:15.143657 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7d8dl"] Jun 07 19:30:15.144358 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:15.143780 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:15.144358 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:15.143896 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:30:15.146811 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:15.146762 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mdddh"] Jun 07 19:30:15.146949 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:15.146936 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:15.147086 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:15.147060 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:30:15.147634 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:15.147608 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m2zz9"] Jun 07 19:30:15.147733 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:15.147688 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:15.147798 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:15.147772 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:30:16.757605 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:16.757576 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:16.757987 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:16.757616 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:16.757987 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:16.757694 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:30:16.757987 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:16.757733 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:30:16.757987 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:16.757770 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:16.757987 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:16.757854 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:30:18.754276 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:18.754246 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:18.754276 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:18.754260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:18.754850 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:18.754260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:18.754850 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:18.754348 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdddh" podUID="4bd39616-fa08-4d64-975d-b9bb523de55f" Jun 07 19:30:18.754850 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:18.754452 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2zz9" podUID="202249b4-4a9b-4118-94d8-a63381d5d0cd" Jun 07 19:30:18.754850 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:18.754523 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d8dl" podUID="1cc9010f-e635-417d-8648-16996ea61a8d" Jun 07 19:30:19.470144 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.470108 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:19.521678 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.521448 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:19.616452 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.616406 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeReady" Jun 07 19:30:19.616587 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.616553 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 07 19:30:19.657029 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.657001 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-prxrw"] Jun 07 19:30:19.677570 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.677544 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h5qnm"] Jun 07 19:30:19.677763 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.677691 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.680011 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.679975 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 07 19:30:19.680011 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.680007 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j4rvt\"" Jun 07 19:30:19.680188 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.680113 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 07 19:30:19.689532 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.689346 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-prxrw"] Jun 07 19:30:19.689532 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.689389 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h5qnm"] Jun 07 19:30:19.689532 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.689444 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wgh4x"] Jun 07 19:30:19.689764 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.689611 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.691997 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.691980 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 07 19:30:19.692149 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.692129 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 07 19:30:19.692296 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.692284 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 07 19:30:19.692340 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.692321 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 07 19:30:19.692709 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.692692 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s4cfc\"" Jun 07 19:30:19.703460 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.703441 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wgh4x"] Jun 07 19:30:19.703565 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.703496 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wgh4x" Jun 07 19:30:19.705957 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.705936 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 07 19:30:19.706057 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.706015 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zbpvw\"" Jun 07 19:30:19.706119 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.706068 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 07 19:30:19.706119 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.706111 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 07 19:30:19.766087 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.766009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-crio-socket\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.766087 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.766034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ef013d1-0b73-4694-8980-d1438c33ea36-cert\") pod \"ingress-canary-wgh4x\" (UID: \"3ef013d1-0b73-4694-8980-d1438c33ea36\") " pod="openshift-ingress-canary/ingress-canary-wgh4x" Jun 07 19:30:19.766087 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.766053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba6d731a-b057-4a5e-ba58-929e0abe497e-tmp-dir\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.766087 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.766070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba6d731a-b057-4a5e-ba58-929e0abe497e-metrics-tls\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.766087 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.766085 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-data-volume\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.766571 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.766126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.766571 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.766157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ba6d731a-b057-4a5e-ba58-929e0abe497e-config-volume\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.766571 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.766191 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trrdq\" (UniqueName: \"kubernetes.io/projected/ba6d731a-b057-4a5e-ba58-929e0abe497e-kube-api-access-trrdq\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.766571 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.766219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk2ph\" (UniqueName: \"kubernetes.io/projected/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-kube-api-access-fk2ph\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.766571 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.766236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.766571 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.766295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v82sc\" (UniqueName: \"kubernetes.io/projected/3ef013d1-0b73-4694-8980-d1438c33ea36-kube-api-access-v82sc\") pod \"ingress-canary-wgh4x\" (UID: \"3ef013d1-0b73-4694-8980-d1438c33ea36\") " pod="openshift-ingress-canary/ingress-canary-wgh4x" Jun 07 19:30:19.781742 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.781706 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:19.866776 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.866740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba6d731a-b057-4a5e-ba58-929e0abe497e-tmp-dir\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.866776 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.866776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba6d731a-b057-4a5e-ba58-929e0abe497e-metrics-tls\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.867004 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.866791 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-data-volume\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.867004 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.866811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.867004 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.866830 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ba6d731a-b057-4a5e-ba58-929e0abe497e-config-volume\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.867004 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.866856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trrdq\" (UniqueName: \"kubernetes.io/projected/ba6d731a-b057-4a5e-ba58-929e0abe497e-kube-api-access-trrdq\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.867004 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.866897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk2ph\" (UniqueName: \"kubernetes.io/projected/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-kube-api-access-fk2ph\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.867004 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.866934 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.867004 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.866982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v82sc\" (UniqueName: \"kubernetes.io/projected/3ef013d1-0b73-4694-8980-d1438c33ea36-kube-api-access-v82sc\") pod \"ingress-canary-wgh4x\" (UID: \"3ef013d1-0b73-4694-8980-d1438c33ea36\") " pod="openshift-ingress-canary/ingress-canary-wgh4x" Jun 07 19:30:19.867343 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.867029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-crio-socket\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.867343 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.867049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ef013d1-0b73-4694-8980-d1438c33ea36-cert\") pod \"ingress-canary-wgh4x\" (UID: \"3ef013d1-0b73-4694-8980-d1438c33ea36\") " pod="openshift-ingress-canary/ingress-canary-wgh4x" Jun 07 19:30:19.867343 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.867178 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-data-volume\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.867343 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.867264 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-crio-socket\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.867568 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.867540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ba6d731a-b057-4a5e-ba58-929e0abe497e-config-volume\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.867621 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.867583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba6d731a-b057-4a5e-ba58-929e0abe497e-tmp-dir\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.867695 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.867678 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.870849 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.870829 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba6d731a-b057-4a5e-ba58-929e0abe497e-metrics-tls\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.870977 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.870849 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.871033 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.871004 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ef013d1-0b73-4694-8980-d1438c33ea36-cert\") pod \"ingress-canary-wgh4x\" (UID: \"3ef013d1-0b73-4694-8980-d1438c33ea36\") " pod="openshift-ingress-canary/ingress-canary-wgh4x" Jun 07 19:30:19.874321 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.874292 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk2ph\" (UniqueName: \"kubernetes.io/projected/c6abe4d3-964e-4baf-9b5b-d29533e8bff3-kube-api-access-fk2ph\") pod \"insights-runtime-extractor-h5qnm\" (UID: \"c6abe4d3-964e-4baf-9b5b-d29533e8bff3\") " pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:19.874432 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.874338 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trrdq\" (UniqueName: \"kubernetes.io/projected/ba6d731a-b057-4a5e-ba58-929e0abe497e-kube-api-access-trrdq\") pod \"dns-default-prxrw\" (UID: \"ba6d731a-b057-4a5e-ba58-929e0abe497e\") " pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.874707 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.874688 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v82sc\" (UniqueName: \"kubernetes.io/projected/3ef013d1-0b73-4694-8980-d1438c33ea36-kube-api-access-v82sc\") pod \"ingress-canary-wgh4x\" (UID: \"3ef013d1-0b73-4694-8980-d1438c33ea36\") " pod="openshift-ingress-canary/ingress-canary-wgh4x" Jun 07 19:30:19.987737 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.987699 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:19.998248 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:19.998223 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h5qnm" Jun 07 19:30:20.011356 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.011336 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wgh4x" Jun 07 19:30:20.192053 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.192023 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h5qnm"] Jun 07 19:30:20.195915 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.195892 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-prxrw"] Jun 07 19:30:20.196018 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:20.195967 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6abe4d3_964e_4baf_9b5b_d29533e8bff3.slice/crio-c3243d46acde65e4994d812b2425477bf78b325a581c4bd6f48225d5acc3e1dd WatchSource:0}: Error finding container c3243d46acde65e4994d812b2425477bf78b325a581c4bd6f48225d5acc3e1dd: Status 404 returned error can't find the container with id c3243d46acde65e4994d812b2425477bf78b325a581c4bd6f48225d5acc3e1dd Jun 07 19:30:20.198697 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:20.198673 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6d731a_b057_4a5e_ba58_929e0abe497e.slice/crio-f887cd2acbc6bb733a7ec092a11ad37b33762b9f601713ebdb13f98d067bca01 WatchSource:0}: Error finding container f887cd2acbc6bb733a7ec092a11ad37b33762b9f601713ebdb13f98d067bca01: Status 404 returned error can't find the container with id f887cd2acbc6bb733a7ec092a11ad37b33762b9f601713ebdb13f98d067bca01 Jun 07 19:30:20.202807 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.202785 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wgh4x"] Jun 07 19:30:20.206938 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:20.206918 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef013d1_0b73_4694_8980_d1438c33ea36.slice/crio-31c48496237ffcdeb1bd8d0e5e0095d649513dc4469a7f2aee8e36a289968151 WatchSource:0}: Error finding container 31c48496237ffcdeb1bd8d0e5e0095d649513dc4469a7f2aee8e36a289968151: Status 404 returned error can't find the container with id 31c48496237ffcdeb1bd8d0e5e0095d649513dc4469a7f2aee8e36a289968151 Jun 07 19:30:20.754553 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.754320 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:20.754553 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.754363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:20.754553 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.754320 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:20.758107 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.758070 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 19:30:20.758244 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.758157 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 19:30:20.758396 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.758271 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 19:30:20.758396 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.758376 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sqxp8\"" Jun 07 19:30:20.758556 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.758494 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 19:30:20.758690 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.758676 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x69m8\"" Jun 07 19:30:20.998762 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:20.998537 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wgh4x" event={"ID":"3ef013d1-0b73-4694-8980-d1438c33ea36","Type":"ContainerStarted","Data":"31c48496237ffcdeb1bd8d0e5e0095d649513dc4469a7f2aee8e36a289968151"} Jun 07 19:30:21.000492 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.000448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5qnm" event={"ID":"c6abe4d3-964e-4baf-9b5b-d29533e8bff3","Type":"ContainerStarted","Data":"25704742bd453ef0720cb2a7dda0f8823ac1d67176e1b954da3aeb77b2e98820"} Jun 07 19:30:21.000617 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.000526 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5qnm" event={"ID":"c6abe4d3-964e-4baf-9b5b-d29533e8bff3","Type":"ContainerStarted","Data":"c3243d46acde65e4994d812b2425477bf78b325a581c4bd6f48225d5acc3e1dd"} Jun 07 19:30:21.001719 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.001685 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-prxrw" event={"ID":"ba6d731a-b057-4a5e-ba58-929e0abe497e","Type":"ContainerStarted","Data":"f887cd2acbc6bb733a7ec092a11ad37b33762b9f601713ebdb13f98d067bca01"} Jun 07 19:30:21.312460 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.312428 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5486cf55-bjtw6"] Jun 07 19:30:21.330270 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.330233 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5486cf55-bjtw6"] Jun 07 19:30:21.330433 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.330328 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.333088 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.333054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 07 19:30:21.333203 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.333109 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 07 19:30:21.333203 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.333065 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 07 19:30:21.333302 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.333065 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 07 19:30:21.334006 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.333983 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 07 19:30:21.334006 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.333988 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q4vx4\"" Jun 07 19:30:21.334183 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.334024 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 07 19:30:21.334183 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.334069 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 07 19:30:21.379284 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.379257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-config\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.379455 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.379306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2rvj\" (UniqueName: \"kubernetes.io/projected/41452ac9-beeb-4a75-9b8f-6b0db298b244-kube-api-access-b2rvj\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.379455 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.379381 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-oauth-serving-cert\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.379455 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.379446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-serving-cert\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.379584 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.379468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-oauth-config\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.379584 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.379492 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-service-ca\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.480345 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.480309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-serving-cert\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.480345 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.480358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-oauth-config\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.480609 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.480383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-service-ca\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.480609 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.480407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-config\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.480609 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.480537 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2rvj\" (UniqueName: \"kubernetes.io/projected/41452ac9-beeb-4a75-9b8f-6b0db298b244-kube-api-access-b2rvj\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.480609 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.480602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-oauth-serving-cert\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.481236 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.481213 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-service-ca\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.481236 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.481230 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-config\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.481392 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.481286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-oauth-serving-cert\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.484265 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.484231 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-oauth-config\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.484265 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.484256 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-serving-cert\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.487838 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.487819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2rvj\" (UniqueName: \"kubernetes.io/projected/41452ac9-beeb-4a75-9b8f-6b0db298b244-kube-api-access-b2rvj\") pod \"console-7f5486cf55-bjtw6\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.641713 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.641632 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:21.903951 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:21.903865 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:22.887067 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:22.887041 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5486cf55-bjtw6"] Jun 07 19:30:22.891937 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:22.891913 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41452ac9_beeb_4a75_9b8f_6b0db298b244.slice/crio-a757aa8f5380682b9ca88d68ea13cfd3ad7d8c63da0136b34e08702ab0d46dfd WatchSource:0}: Error finding container a757aa8f5380682b9ca88d68ea13cfd3ad7d8c63da0136b34e08702ab0d46dfd: Status 404 returned error can't find the container with id a757aa8f5380682b9ca88d68ea13cfd3ad7d8c63da0136b34e08702ab0d46dfd Jun 07 19:30:23.007713 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:23.007684 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5486cf55-bjtw6" event={"ID":"41452ac9-beeb-4a75-9b8f-6b0db298b244","Type":"ContainerStarted","Data":"a757aa8f5380682b9ca88d68ea13cfd3ad7d8c63da0136b34e08702ab0d46dfd"} Jun 07 19:30:23.009399 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:23.009374 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5qnm" event={"ID":"c6abe4d3-964e-4baf-9b5b-d29533e8bff3","Type":"ContainerStarted","Data":"19931ace3b28aaf1facff341679220adad0da6a22b896e9142eaed8b841d836d"} Jun 07 19:30:23.010949 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:23.010714 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-prxrw" event={"ID":"ba6d731a-b057-4a5e-ba58-929e0abe497e","Type":"ContainerStarted","Data":"f166d0e88a11a4990d14b3f4678ed06d2ce5af804e86d06a720ad17e25b037d6"} Jun 07 19:30:23.014529 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:23.014503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wgh4x" event={"ID":"3ef013d1-0b73-4694-8980-d1438c33ea36","Type":"ContainerStarted","Data":"d96aa7292bc12e23f5194473c356dac3e36808e510442453b820a00423393f6f"} Jun 07 19:30:23.028445 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:23.028388 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wgh4x" podStartSLOduration=1.483518125 podStartE2EDuration="4.028372835s" totalImagesPullingTime="2.54485471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:23.028028973 +0000 UTC m=+50.703053871" watchObservedRunningTime="2026-06-07 19:30:23.028372835 +0000 UTC m=+50.703397733" Jun 07 19:30:23.206974 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:23.206938 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:23.256540 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:23.256456 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:24.021592 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:24.021543 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-prxrw" event={"ID":"ba6d731a-b057-4a5e-ba58-929e0abe497e","Type":"ContainerStarted","Data":"a0de7798c4f979cc872a04d7a67a94557d3c698f21e3875d4c8df8433a04e06b"} Jun 07 19:30:24.038835 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:24.038769 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-prxrw" podStartSLOduration=2.490231824 podStartE2EDuration="5.038747731s" totalImagesPullingTime="2.548515907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:24.037450164 +0000 UTC m=+51.712475055" watchObservedRunningTime="2026-06-07 19:30:24.038747731 +0000 UTC m=+51.713772630" Jun 07 19:30:25.025631 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:25.025590 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5qnm" event={"ID":"c6abe4d3-964e-4baf-9b5b-d29533e8bff3","Type":"ContainerStarted","Data":"9ade2ef8cacc5dd17858fe5ff4301755f3aa53d5d0634413b67d48397cb845a8"} Jun 07 19:30:25.026070 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:25.026053 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:25.043677 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:25.043627 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h5qnm" podStartSLOduration=1.813548033 podStartE2EDuration="6.043614547s" totalImagesPullingTime="4.230066514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:30:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:25.042591586 +0000 UTC m=+52.717616483" watchObservedRunningTime="2026-06-07 19:30:25.043614547 +0000 UTC m=+52.718639447" Jun 07 19:30:26.514575 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.514538 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f46c6586f-rbp7c"] Jun 07 19:30:26.527255 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.527226 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f46c6586f-rbp7c"] Jun 07 19:30:26.527376 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.527349 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.535084 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.534983 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 07 19:30:26.619525 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.619440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-service-ca\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.619525 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.619476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-oauth-serving-cert\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.619714 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.619554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-serving-cert\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.619714 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.619569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-oauth-config\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.619714 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.619587 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-trusted-ca-bundle\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.619714 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.619645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-config\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.619714 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.619683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkxs4\" (UniqueName: \"kubernetes.io/projected/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-kube-api-access-zkxs4\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.720139 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.720106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-service-ca\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.720139 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.720140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-oauth-serving-cert\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.720382 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.720282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-serving-cert\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.720382 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.720312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-oauth-config\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.720382 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.720331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-trusted-ca-bundle\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.720382 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.720376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-config\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.720609 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.720409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkxs4\" (UniqueName: \"kubernetes.io/projected/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-kube-api-access-zkxs4\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.720913 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.720888 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-service-ca\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.721018 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.720922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-oauth-serving-cert\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.721093 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.721074 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-config\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.721205 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.721188 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-trusted-ca-bundle\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.724297 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.724191 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-oauth-config\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.724372 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.724223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-serving-cert\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.732631 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.732609 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkxs4\" (UniqueName: \"kubernetes.io/projected/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-kube-api-access-zkxs4\") pod \"console-f46c6586f-rbp7c\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.756034 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.756005 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:26.837700 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.837657 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:26.916349 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.916266 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:26.918864 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.918835 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx"] Jun 07 19:30:26.940383 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.940355 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx"] Jun 07 19:30:26.940523 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.940490 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx" Jun 07 19:30:26.943250 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.943184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f42mg\"" Jun 07 19:30:26.943250 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.943208 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 07 19:30:26.985242 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:26.985216 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f46c6586f-rbp7c"] Jun 07 19:30:26.988340 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:26.988318 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c4f669_e4bf_4b2f_89a4_e90479cb1c2e.slice/crio-ea1ce437ff11004fd221376aa7ebe745978cbc8fa2680948fb01b3113e672474 WatchSource:0}: Error finding container ea1ce437ff11004fd221376aa7ebe745978cbc8fa2680948fb01b3113e672474: Status 404 returned error can't find the container with id ea1ce437ff11004fd221376aa7ebe745978cbc8fa2680948fb01b3113e672474 Jun 07 19:30:27.019204 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.019177 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:27.023087 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.023063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fe4ba456-a67c-44a8-a02c-7caa695bd961-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-m6xwx\" (UID: \"fe4ba456-a67c-44a8-a02c-7caa695bd961\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx" Jun 07 19:30:27.033587 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.033559 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f46c6586f-rbp7c" event={"ID":"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e","Type":"ContainerStarted","Data":"ea1ce437ff11004fd221376aa7ebe745978cbc8fa2680948fb01b3113e672474"} Jun 07 19:30:27.034904 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.034884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5486cf55-bjtw6" event={"ID":"41452ac9-beeb-4a75-9b8f-6b0db298b244","Type":"ContainerStarted","Data":"d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741"} Jun 07 19:30:27.050833 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.050792 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f5486cf55-bjtw6" podStartSLOduration=2.5988608170000003 podStartE2EDuration="6.050778734s" totalImagesPullingTime="3.451917917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:27.049855985 +0000 UTC m=+54.724880884" watchObservedRunningTime="2026-06-07 19:30:27.050778734 +0000 UTC m=+54.725803626" Jun 07 19:30:27.115642 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.115615 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:27.123633 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.123610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fe4ba456-a67c-44a8-a02c-7caa695bd961-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-m6xwx\" (UID: \"fe4ba456-a67c-44a8-a02c-7caa695bd961\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx" Jun 07 19:30:27.124156 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:27.123798 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 07 19:30:27.124156 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:27.123865 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4ba456-a67c-44a8-a02c-7caa695bd961-tls-certificates podName:fe4ba456-a67c-44a8-a02c-7caa695bd961 nodeName:}" failed. No retries permitted until 2026-06-07 19:30:27.623846614 +0000 UTC m=+55.298871506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/fe4ba456-a67c-44a8-a02c-7caa695bd961-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-m6xwx" (UID: "fe4ba456-a67c-44a8-a02c-7caa695bd961") : secret "prometheus-operator-admission-webhook-tls" not found Jun 07 19:30:27.409870 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.409837 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:27.626726 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.626683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fe4ba456-a67c-44a8-a02c-7caa695bd961-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-m6xwx\" (UID: \"fe4ba456-a67c-44a8-a02c-7caa695bd961\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx" Jun 07 19:30:27.629508 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.629487 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fe4ba456-a67c-44a8-a02c-7caa695bd961-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-m6xwx\" (UID: \"fe4ba456-a67c-44a8-a02c-7caa695bd961\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx" Jun 07 19:30:27.850514 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.850481 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx" Jun 07 19:30:27.985494 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:27.985308 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx"] Jun 07 19:30:27.988335 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:27.988308 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4ba456_a67c_44a8_a02c_7caa695bd961.slice/crio-f7e9e9685768108c30d127bf13b43704934f071f7723570cb622abada5cae336 WatchSource:0}: Error finding container f7e9e9685768108c30d127bf13b43704934f071f7723570cb622abada5cae336: Status 404 returned error can't find the container with id f7e9e9685768108c30d127bf13b43704934f071f7723570cb622abada5cae336 Jun 07 19:30:28.039388 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:28.039358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx" event={"ID":"fe4ba456-a67c-44a8-a02c-7caa695bd961","Type":"ContainerStarted","Data":"f7e9e9685768108c30d127bf13b43704934f071f7723570cb622abada5cae336"} Jun 07 19:30:28.040883 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:28.040862 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f46c6586f-rbp7c" event={"ID":"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e","Type":"ContainerStarted","Data":"9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc"} Jun 07 19:30:28.057204 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:28.057162 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f46c6586f-rbp7c" podStartSLOduration=2.05714775 podStartE2EDuration="2.05714775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:30:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:28.05655716 +0000 UTC m=+55.731582054" watchObservedRunningTime="2026-06-07 19:30:28.05714775 +0000 UTC m=+55.732172647" Jun 07 19:30:28.114098 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:28.113988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:28.168035 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:28.167991 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:29.209325 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:29.209268 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:29.254932 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:29.254891 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:29.981204 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:29.981170 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:30.030537 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.030505 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:30.049833 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.049802 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx" event={"ID":"fe4ba456-a67c-44a8-a02c-7caa695bd961","Type":"ContainerStarted","Data":"645ad85e6106a1d3a6388509a63f5f8adb9dc37c9b5279704470f65b7ea70abf"} Jun 07 19:30:30.050023 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.050008 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx" Jun 07 19:30:30.054575 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.054555 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx" Jun 07 19:30:30.063941 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.063904 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m6xwx" podStartSLOduration=2.790626465 podStartE2EDuration="4.063892163s" totalImagesPullingTime="1.273265698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:30.063440456 +0000 UTC m=+57.738465365" watchObservedRunningTime="2026-06-07 19:30:30.063892163 +0000 UTC m=+57.738917060" Jun 07 19:30:30.421974 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.421935 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:30.467939 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.467910 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:30.944795 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.944763 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:30.973398 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.973370 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq"] Jun 07 19:30:30.975448 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.975431 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:30.978954 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.978935 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 07 19:30:30.979083 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.979066 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8nnw9\"" Jun 07 19:30:30.979140 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.979067 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 07 19:30:30.979140 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.979068 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 07 19:30:30.979244 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.979157 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 07 19:30:30.979244 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.979178 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 07 19:30:30.986172 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:30.986153 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq"] Jun 07 19:30:31.006841 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.006816 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:31.057575 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.057550 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/904294c2-de36-4868-b506-fbea70cf8812-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.057708 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.057606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsbsk\" (UniqueName: \"kubernetes.io/projected/904294c2-de36-4868-b506-fbea70cf8812-kube-api-access-lsbsk\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.057708 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.057663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/904294c2-de36-4868-b506-fbea70cf8812-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.057708 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.057699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904294c2-de36-4868-b506-fbea70cf8812-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.159397 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.159355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsbsk\" (UniqueName: \"kubernetes.io/projected/904294c2-de36-4868-b506-fbea70cf8812-kube-api-access-lsbsk\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.159572 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.159437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/904294c2-de36-4868-b506-fbea70cf8812-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.159572 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.159518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904294c2-de36-4868-b506-fbea70cf8812-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.159700 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.159602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/904294c2-de36-4868-b506-fbea70cf8812-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.160894 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:31.159751 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 07 19:30:31.160894 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:31.159822 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904294c2-de36-4868-b506-fbea70cf8812-prometheus-operator-tls podName:904294c2-de36-4868-b506-fbea70cf8812 nodeName:}" failed. No retries permitted until 2026-06-07 19:30:31.659797775 +0000 UTC m=+59.334822655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/904294c2-de36-4868-b506-fbea70cf8812-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-f8hfq" (UID: "904294c2-de36-4868-b506-fbea70cf8812") : secret "prometheus-operator-tls" not found Jun 07 19:30:31.163341 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.163313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904294c2-de36-4868-b506-fbea70cf8812-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.164532 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.164509 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/904294c2-de36-4868-b506-fbea70cf8812-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.167862 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.167846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsbsk\" (UniqueName: \"kubernetes.io/projected/904294c2-de36-4868-b506-fbea70cf8812-kube-api-access-lsbsk\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.319628 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.319596 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:31.642583 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.642488 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:31.642972 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.642831 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:30:31.643982 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.643960 2562 patch_prober.go:28] interesting pod/console-7f5486cf55-bjtw6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused" start-of-body= Jun 07 19:30:31.644030 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.644003 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7f5486cf55-bjtw6" podUID="41452ac9-beeb-4a75-9b8f-6b0db298b244" containerName="console" probeResult="failure" output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused" Jun 07 19:30:31.662610 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.662585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/904294c2-de36-4868-b506-fbea70cf8812-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.664889 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.664867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/904294c2-de36-4868-b506-fbea70cf8812-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-f8hfq\" (UID: \"904294c2-de36-4868-b506-fbea70cf8812\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.884076 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.884026 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" Jun 07 19:30:31.948961 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:31.948937 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8xwp" Jun 07 19:30:32.003196 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:32.003163 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq"] Jun 07 19:30:32.005995 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:32.005973 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904294c2_de36_4868_b506_fbea70cf8812.slice/crio-c548d037297666acf97f298ff78a266609f174dff36765701ea3611e00641a75 WatchSource:0}: Error finding container c548d037297666acf97f298ff78a266609f174dff36765701ea3611e00641a75: Status 404 returned error can't find the container with id c548d037297666acf97f298ff78a266609f174dff36765701ea3611e00641a75 Jun 07 19:30:32.031028 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:32.031008 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-prxrw" Jun 07 19:30:32.058006 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:32.057955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" event={"ID":"904294c2-de36-4868-b506-fbea70cf8812","Type":"ContainerStarted","Data":"c548d037297666acf97f298ff78a266609f174dff36765701ea3611e00641a75"} Jun 07 19:30:32.099635 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:32.099598 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:32.199334 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:32.199260 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:33.644055 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:33.644017 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:34.066525 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:34.066484 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" event={"ID":"904294c2-de36-4868-b506-fbea70cf8812","Type":"ContainerStarted","Data":"84c2b7b4ac027c5be3d9d3c9672a71a42a483461f98900fb254fd1d14f1015c8"} Jun 07 19:30:34.066721 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:34.066581 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" event={"ID":"904294c2-de36-4868-b506-fbea70cf8812","Type":"ContainerStarted","Data":"ac9cca3b2e85058530f1791657c5dd155c8b2720b9cef941de5b3eecc7e59a08"} Jun 07 19:30:34.081930 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:34.081883 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-f8hfq" podStartSLOduration=2.68694824 podStartE2EDuration="4.081867852s" totalImagesPullingTime="1.394919612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:34.081387731 +0000 UTC m=+61.756412628" watchObservedRunningTime="2026-06-07 19:30:34.081867852 +0000 UTC m=+61.756892781" Jun 07 19:30:35.544558 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:35.544519 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:35.645305 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:35.645271 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:36.068167 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.068125 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:36.170787 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.170752 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:36.272250 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.272221 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:36.302666 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.302638 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n"] Jun 07 19:30:36.304737 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.304722 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.307062 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.307040 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 07 19:30:36.307180 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.307040 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5cg6b\"" Jun 07 19:30:36.307180 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.307046 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 07 19:30:36.313795 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.313775 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n"] Jun 07 19:30:36.317631 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.317608 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z2dcj"] Jun 07 19:30:36.323605 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.323556 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc"] Jun 07 19:30:36.323682 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.323669 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.325614 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.325591 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.326761 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.326744 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 07 19:30:36.327174 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.327158 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 07 19:30:36.327267 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.327215 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m8fvm\"" Jun 07 19:30:36.327323 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.327264 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 07 19:30:36.327892 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.327875 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 07 19:30:36.328237 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.328218 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 07 19:30:36.328343 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.328315 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xfbrc\"" Jun 07 19:30:36.328392 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.328348 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 07 19:30:36.338993 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.338974 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc"] Jun 07 19:30:36.381118 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.381065 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:36.400080 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf82a39-9d8a-434c-8a75-9cde12c4b129-metrics-client-ca\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.400198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/236a31f7-ee63-421e-a91e-1150773b15c8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.400198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/236a31f7-ee63-421e-a91e-1150773b15c8-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.400198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jhsx\" (UniqueName: \"kubernetes.io/projected/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-api-access-5jhsx\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.400198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400159 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxvk\" (UniqueName: \"kubernetes.io/projected/dbf82a39-9d8a-434c-8a75-9cde12c4b129-kube-api-access-pxxvk\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.400198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd54a62e-a621-42ba-b7ca-27725b0e5e32-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.400198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.400380 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbf82a39-9d8a-434c-8a75-9cde12c4b129-root\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.400380 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd54a62e-a621-42ba-b7ca-27725b0e5e32-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.400380 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400278 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.400380 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.400380 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-tls\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.400380 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbf82a39-9d8a-434c-8a75-9cde12c4b129-sys\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.400625 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/236a31f7-ee63-421e-a91e-1150773b15c8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.400625 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.400625 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400486 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-textfile\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.400625 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-wtmp\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.400625 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87bvf\" (UniqueName: \"kubernetes.io/projected/236a31f7-ee63-421e-a91e-1150773b15c8-kube-api-access-87bvf\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.400625 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.400573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.472229 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.472200 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:36.501309 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-textfile\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.501501 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-wtmp\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.501501 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87bvf\" (UniqueName: \"kubernetes.io/projected/236a31f7-ee63-421e-a91e-1150773b15c8-kube-api-access-87bvf\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.501501 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.501501 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf82a39-9d8a-434c-8a75-9cde12c4b129-metrics-client-ca\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.501717 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/236a31f7-ee63-421e-a91e-1150773b15c8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.501717 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/236a31f7-ee63-421e-a91e-1150773b15c8-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.501717 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501546 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-wtmp\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.501717 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jhsx\" (UniqueName: \"kubernetes.io/projected/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-api-access-5jhsx\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.501717 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxvk\" (UniqueName: \"kubernetes.io/projected/dbf82a39-9d8a-434c-8a75-9cde12c4b129-kube-api-access-pxxvk\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.501717 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501632 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd54a62e-a621-42ba-b7ca-27725b0e5e32-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.501717 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:36.501646 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 07 19:30:36.501717 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501651 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-textfile\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.501717 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501656 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.501717 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:36.501722 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236a31f7-ee63-421e-a91e-1150773b15c8-openshift-state-metrics-tls podName:236a31f7-ee63-421e-a91e-1150773b15c8 nodeName:}" failed. No retries permitted until 2026-06-07 19:30:37.001699682 +0000 UTC m=+64.676724559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/236a31f7-ee63-421e-a91e-1150773b15c8-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-4rp4n" (UID: "236a31f7-ee63-421e-a91e-1150773b15c8") : secret "openshift-state-metrics-tls" not found Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbf82a39-9d8a-434c-8a75-9cde12c4b129-root\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd54a62e-a621-42ba-b7ca-27725b0e5e32-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501817 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501877 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-tls\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbf82a39-9d8a-434c-8a75-9cde12c4b129-sys\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/236a31f7-ee63-421e-a91e-1150773b15c8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:36.501982 2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.501995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.502039 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbf82a39-9d8a-434c-8a75-9cde12c4b129-root\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:30:36.502053 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-tls podName:bd54a62e-a621-42ba-b7ca-27725b0e5e32 nodeName:}" failed. No retries permitted until 2026-06-07 19:30:37.002036581 +0000 UTC m=+64.677061456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-488qc" (UID: "bd54a62e-a621-42ba-b7ca-27725b0e5e32") : secret "kube-state-metrics-tls" not found Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.502108 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbf82a39-9d8a-434c-8a75-9cde12c4b129-sys\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.502232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.502113 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf82a39-9d8a-434c-8a75-9cde12c4b129-metrics-client-ca\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.502888 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.502302 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/236a31f7-ee63-421e-a91e-1150773b15c8-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.502888 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.502506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd54a62e-a621-42ba-b7ca-27725b0e5e32-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.502888 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.502586 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd54a62e-a621-42ba-b7ca-27725b0e5e32-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.502888 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.502698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.503088 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.502904 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.504339 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.504314 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.504545 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.504527 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.504631 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.504593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbf82a39-9d8a-434c-8a75-9cde12c4b129-node-exporter-tls\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.504681 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.504639 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/236a31f7-ee63-421e-a91e-1150773b15c8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.509780 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.509733 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxvk\" (UniqueName: \"kubernetes.io/projected/dbf82a39-9d8a-434c-8a75-9cde12c4b129-kube-api-access-pxxvk\") pod \"node-exporter-z2dcj\" (UID: \"dbf82a39-9d8a-434c-8a75-9cde12c4b129\") " pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.510144 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.510126 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87bvf\" (UniqueName: \"kubernetes.io/projected/236a31f7-ee63-421e-a91e-1150773b15c8-kube-api-access-87bvf\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:36.510227 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.510144 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jhsx\" (UniqueName: \"kubernetes.io/projected/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-api-access-5jhsx\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:36.592307 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.592233 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:36.633333 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.633307 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2dcj" Jun 07 19:30:36.642631 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:36.642604 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf82a39_9d8a_434c_8a75_9cde12c4b129.slice/crio-3536a28152a2dec87eac99e89ff0c7aff6ef2382c939ddedaebeedc8b4d3fdae WatchSource:0}: Error finding container 3536a28152a2dec87eac99e89ff0c7aff6ef2382c939ddedaebeedc8b4d3fdae: Status 404 returned error can't find the container with id 3536a28152a2dec87eac99e89ff0c7aff6ef2382c939ddedaebeedc8b4d3fdae Jun 07 19:30:36.648092 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.648049 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:36.740475 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.740440 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:36.838324 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.838291 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:36.838508 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.838346 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:36.839669 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.839638 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:36.843113 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.843061 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:36.939704 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:36.939677 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:37.007148 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.007111 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/236a31f7-ee63-421e-a91e-1150773b15c8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:37.007296 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.007155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:37.009464 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.009440 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd54a62e-a621-42ba-b7ca-27725b0e5e32-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-488qc\" (UID: \"bd54a62e-a621-42ba-b7ca-27725b0e5e32\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:37.009567 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.009503 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/236a31f7-ee63-421e-a91e-1150773b15c8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4rp4n\" (UID: \"236a31f7-ee63-421e-a91e-1150773b15c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:37.076493 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.076464 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2dcj" event={"ID":"dbf82a39-9d8a-434c-8a75-9cde12c4b129","Type":"ContainerStarted","Data":"3536a28152a2dec87eac99e89ff0c7aff6ef2382c939ddedaebeedc8b4d3fdae"} Jun 07 19:30:37.080330 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.080309 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:30:37.127570 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.127503 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5486cf55-bjtw6"] Jun 07 19:30:37.175573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.175538 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:37.214513 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.214482 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" Jun 07 19:30:37.239651 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.239621 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" Jun 07 19:30:37.279198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.279092 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:37.375777 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.375735 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n"] Jun 07 19:30:37.379173 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.379144 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:37.380096 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:37.380075 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236a31f7_ee63_421e_a91e_1150773b15c8.slice/crio-84073232c9f1b4fdb432f891721ebf03cfb30efed97f39adf548c4aecc515ca7 WatchSource:0}: Error finding container 84073232c9f1b4fdb432f891721ebf03cfb30efed97f39adf548c4aecc515ca7: Status 404 returned error can't find the container with id 84073232c9f1b4fdb432f891721ebf03cfb30efed97f39adf548c4aecc515ca7 Jun 07 19:30:37.391338 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.391314 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc"] Jun 07 19:30:37.443885 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.443815 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:37.579558 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:37.579527 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:37.588327 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:37.588302 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd54a62e_a621_42ba_b7ca_27725b0e5e32.slice/crio-4cce12f8cd15e7a1fb3d3ad25de3ca3f1832045134be7914dfc9528f0a60e20f WatchSource:0}: Error finding container 4cce12f8cd15e7a1fb3d3ad25de3ca3f1832045134be7914dfc9528f0a60e20f: Status 404 returned error can't find the container with id 4cce12f8cd15e7a1fb3d3ad25de3ca3f1832045134be7914dfc9528f0a60e20f Jun 07 19:30:38.081681 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.081647 2562 generic.go:356] "Generic (PLEG): container finished" podID="dbf82a39-9d8a-434c-8a75-9cde12c4b129" containerID="89cb3b38ec1f643d4df30aae395143dd29d249218db08ee587c90b43ad6b52fe" exitCode=0 Jun 07 19:30:38.082099 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.081721 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2dcj" event={"ID":"dbf82a39-9d8a-434c-8a75-9cde12c4b129","Type":"ContainerDied","Data":"89cb3b38ec1f643d4df30aae395143dd29d249218db08ee587c90b43ad6b52fe"} Jun 07 19:30:38.082955 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.082926 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" event={"ID":"bd54a62e-a621-42ba-b7ca-27725b0e5e32","Type":"ContainerStarted","Data":"4cce12f8cd15e7a1fb3d3ad25de3ca3f1832045134be7914dfc9528f0a60e20f"} Jun 07 19:30:38.084707 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.084682 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" event={"ID":"236a31f7-ee63-421e-a91e-1150773b15c8","Type":"ContainerStarted","Data":"f2cca42ac2b570af9cc3d6cc08bf6dea405f0353235ac4c75a57f93e16cac630"} Jun 07 19:30:38.084794 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.084739 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" event={"ID":"236a31f7-ee63-421e-a91e-1150773b15c8","Type":"ContainerStarted","Data":"de5a7fa4a9b15fdd99a7c89193e0058a76884c04f5f1f0903f985bf778855417"} Jun 07 19:30:38.084794 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.084769 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" event={"ID":"236a31f7-ee63-421e-a91e-1150773b15c8","Type":"ContainerStarted","Data":"84073232c9f1b4fdb432f891721ebf03cfb30efed97f39adf548c4aecc515ca7"} Jun 07 19:30:38.625044 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.625004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:38.625217 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.625112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:38.627549 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.627526 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 19:30:38.627664 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.627572 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 19:30:38.638361 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.638325 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd39616-fa08-4d64-975d-b9bb523de55f-metrics-certs\") pod \"network-metrics-daemon-mdddh\" (UID: \"4bd39616-fa08-4d64-975d-b9bb523de55f\") " pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:38.638498 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.638365 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc9010f-e635-417d-8648-16996ea61a8d-original-pull-secret\") pod \"global-pull-secret-syncer-7d8dl\" (UID: \"1cc9010f-e635-417d-8648-16996ea61a8d\") " pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:38.725997 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.725951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9b8\" (UniqueName: \"kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8\") pod \"network-check-target-m2zz9\" (UID: \"202249b4-4a9b-4118-94d8-a63381d5d0cd\") " pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:38.728555 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.728529 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 19:30:38.738984 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.738960 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 19:30:38.749850 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.749819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr9b8\" (UniqueName: \"kubernetes.io/projected/202249b4-4a9b-4118-94d8-a63381d5d0cd-kube-api-access-mr9b8\") pod \"network-check-target-m2zz9\" (UID: \"202249b4-4a9b-4118-94d8-a63381d5d0cd\") " pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:38.768954 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.768888 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d8dl" Jun 07 19:30:38.781320 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.781292 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x69m8\"" Jun 07 19:30:38.786783 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.786762 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sqxp8\"" Jun 07 19:30:38.789634 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.789619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdddh" Jun 07 19:30:38.794539 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:38.794521 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:39.095501 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.095353 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2dcj" event={"ID":"dbf82a39-9d8a-434c-8a75-9cde12c4b129","Type":"ContainerStarted","Data":"9e911c800de18cf09a99a85d19a9fd514aaedcdaf71f1033ffc0f2c6b309e986"} Jun 07 19:30:39.095501 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.095444 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2dcj" event={"ID":"dbf82a39-9d8a-434c-8a75-9cde12c4b129","Type":"ContainerStarted","Data":"8c230097bcca6a319619c444262e96889cae12658011772eead23a21724c7c35"} Jun 07 19:30:39.104608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.104527 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" event={"ID":"bd54a62e-a621-42ba-b7ca-27725b0e5e32","Type":"ContainerStarted","Data":"6b36e3c387d978b6afd15003dc610fb63644ae02b09228057dde8484e40ac2e6"} Jun 07 19:30:39.107655 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.107026 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" event={"ID":"236a31f7-ee63-421e-a91e-1150773b15c8","Type":"ContainerStarted","Data":"65f6987bf37d975660726ca54506a5aaa7cc3f5801d976c78391192fd0b41bca"} Jun 07 19:30:39.115481 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.113725 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z2dcj" podStartSLOduration=2.075196292 podStartE2EDuration="3.113706782s" totalImagesPullingTime="970.105544ms" totalInitContainerRuntime="68.404946ms" isStatefulPod=true podCreationTimestamp="2026-06-07 19:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:39.113288505 +0000 UTC m=+66.788313404" watchObservedRunningTime="2026-06-07 19:30:39.113706782 +0000 UTC m=+66.788731660" Jun 07 19:30:39.141477 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.141399 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4rp4n" podStartSLOduration=1.879601826 podStartE2EDuration="3.141376629s" totalImagesPullingTime="1.261774803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:39.139769848 +0000 UTC m=+66.814794759" watchObservedRunningTime="2026-06-07 19:30:39.141376629 +0000 UTC m=+66.816401527" Jun 07 19:30:39.145891 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.145827 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mdddh"] Jun 07 19:30:39.147651 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:39.147232 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd39616_fa08_4d64_975d_b9bb523de55f.slice/crio-6635879567d9211f81da7288bbdf6ea6611b94af81621d719f77a74cbed8dc0b WatchSource:0}: Error finding container 6635879567d9211f81da7288bbdf6ea6611b94af81621d719f77a74cbed8dc0b: Status 404 returned error can't find the container with id 6635879567d9211f81da7288bbdf6ea6611b94af81621d719f77a74cbed8dc0b Jun 07 19:30:39.172357 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.172327 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7d8dl"] Jun 07 19:30:39.179507 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:39.179265 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc9010f_e635_417d_8648_16996ea61a8d.slice/crio-a21d3933c9ff3ffe36df64be9b077d5dca851f98dfb29699f885b2f3d1ecbf41 WatchSource:0}: Error finding container a21d3933c9ff3ffe36df64be9b077d5dca851f98dfb29699f885b2f3d1ecbf41: Status 404 returned error can't find the container with id a21d3933c9ff3ffe36df64be9b077d5dca851f98dfb29699f885b2f3d1ecbf41 Jun 07 19:30:39.284636 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.284550 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:39.342197 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.342146 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:39.364751 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.364721 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m2zz9"] Jun 07 19:30:39.367849 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:39.367822 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202249b4_4a9b_4118_94d8_a63381d5d0cd.slice/crio-4e805914d18b4cf1257bafe38ed2ef5b9af04947e35eacbd957acd6fb212d06f WatchSource:0}: Error finding container 4e805914d18b4cf1257bafe38ed2ef5b9af04947e35eacbd957acd6fb212d06f: Status 404 returned error can't find the container with id 4e805914d18b4cf1257bafe38ed2ef5b9af04947e35eacbd957acd6fb212d06f Jun 07 19:30:39.637334 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.637246 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:39.744207 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:39.744048 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:40.083849 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:40.083797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:40.114438 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:40.114285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" event={"ID":"bd54a62e-a621-42ba-b7ca-27725b0e5e32","Type":"ContainerStarted","Data":"9f4c9a72255705d0b17c9105c482eeaed806b0e68ebbbb6f6c45827e9035df20"} Jun 07 19:30:40.114438 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:40.114383 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" event={"ID":"bd54a62e-a621-42ba-b7ca-27725b0e5e32","Type":"ContainerStarted","Data":"f358942258231fb09fbf57f1cdbea3801b1a0ba2d5428aa0a9a26d29048f351e"} Jun 07 19:30:40.116325 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:40.116255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m2zz9" event={"ID":"202249b4-4a9b-4118-94d8-a63381d5d0cd","Type":"ContainerStarted","Data":"4e805914d18b4cf1257bafe38ed2ef5b9af04947e35eacbd957acd6fb212d06f"} Jun 07 19:30:40.117829 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:40.117777 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7d8dl" event={"ID":"1cc9010f-e635-417d-8648-16996ea61a8d","Type":"ContainerStarted","Data":"a21d3933c9ff3ffe36df64be9b077d5dca851f98dfb29699f885b2f3d1ecbf41"} Jun 07 19:30:40.119355 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:40.119223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mdddh" event={"ID":"4bd39616-fa08-4d64-975d-b9bb523de55f","Type":"ContainerStarted","Data":"6635879567d9211f81da7288bbdf6ea6611b94af81621d719f77a74cbed8dc0b"} Jun 07 19:30:40.134052 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:40.133977 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:40.134515 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:40.134452 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-488qc" podStartSLOduration=2.753331368 podStartE2EDuration="4.134434052s" totalImagesPullingTime="1.381102684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:40.131831294 +0000 UTC m=+67.806856205" watchObservedRunningTime="2026-06-07 19:30:40.134434052 +0000 UTC m=+67.809458947" Jun 07 19:30:41.094692 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.094657 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:41.106682 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.106650 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76cdd57fc-jcvwt"] Jun 07 19:30:41.108948 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.108927 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.112853 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.111763 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-mj47n"] Jun 07 19:30:41.114038 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.114016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" Jun 07 19:30:41.117511 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.117488 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 07 19:30:41.117835 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.117569 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6kz75\"" Jun 07 19:30:41.125288 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.125228 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cdd57fc-jcvwt"] Jun 07 19:30:41.127803 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.127776 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-mj47n"] Jun 07 19:30:41.135930 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.135863 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mdddh" event={"ID":"4bd39616-fa08-4d64-975d-b9bb523de55f","Type":"ContainerStarted","Data":"0e46b93ce6b60f4383b2e40718128ef6a80dce262268500e27df769fc450b96d"} Jun 07 19:30:41.135930 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.135916 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mdddh" event={"ID":"4bd39616-fa08-4d64-975d-b9bb523de55f","Type":"ContainerStarted","Data":"2fcc8bf0c55580c530aea881b55f95c669cb355fc81db8520dca3055c017ff63"} Jun 07 19:30:41.157207 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.157178 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:41.167219 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.167131 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mdddh" podStartSLOduration=68.194747945 podStartE2EDuration="1m9.167112417s" totalImagesPullingTime="972.364472ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:41.166122967 +0000 UTC m=+68.841147866" watchObservedRunningTime="2026-06-07 19:30:41.167112417 +0000 UTC m=+68.842137315" Jun 07 19:30:41.247922 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.247882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkcst\" (UniqueName: \"kubernetes.io/projected/70e4df2e-82ab-4775-936e-23b3446d8c53-kube-api-access-rkcst\") pod \"monitoring-plugin-76b68cc874-mj47n\" (UID: \"70e4df2e-82ab-4775-936e-23b3446d8c53\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" Jun 07 19:30:41.248101 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.247947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-serving-cert\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.248156 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.248107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-oauth-config\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.248215 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.248182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-oauth-serving-cert\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.248268 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.248210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-console-config\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.248335 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.248319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70e4df2e-82ab-4775-936e-23b3446d8c53-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-mj47n\" (UID: \"70e4df2e-82ab-4775-936e-23b3446d8c53\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" Jun 07 19:30:41.248401 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.248384 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-trusted-ca-bundle\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.248484 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.248440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-service-ca\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.248484 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.248470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whchd\" (UniqueName: \"kubernetes.io/projected/1af3337e-1e4d-4688-ac82-8fb0de212436-kube-api-access-whchd\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.290180 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.290144 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:41.342434 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.342359 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:41.349381 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.349322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-oauth-serving-cert\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.349381 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.349354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-console-config\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.349608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.349465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70e4df2e-82ab-4775-936e-23b3446d8c53-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-mj47n\" (UID: \"70e4df2e-82ab-4775-936e-23b3446d8c53\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" Jun 07 19:30:41.349608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.349517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-trusted-ca-bundle\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.349608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.349550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-service-ca\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.349608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.349579 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whchd\" (UniqueName: \"kubernetes.io/projected/1af3337e-1e4d-4688-ac82-8fb0de212436-kube-api-access-whchd\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.349826 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.349684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkcst\" (UniqueName: \"kubernetes.io/projected/70e4df2e-82ab-4775-936e-23b3446d8c53-kube-api-access-rkcst\") pod \"monitoring-plugin-76b68cc874-mj47n\" (UID: \"70e4df2e-82ab-4775-936e-23b3446d8c53\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" Jun 07 19:30:41.349826 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.349711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-serving-cert\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.349826 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.349742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-oauth-config\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.350368 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.350102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-oauth-serving-cert\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.350368 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.350176 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-console-config\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.350563 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.350465 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-service-ca\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.350818 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.350788 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-trusted-ca-bundle\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.353044 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.353016 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70e4df2e-82ab-4775-936e-23b3446d8c53-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-mj47n\" (UID: \"70e4df2e-82ab-4775-936e-23b3446d8c53\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" Jun 07 19:30:41.353154 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.353080 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-serving-cert\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.353993 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.353972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-oauth-config\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.357771 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.357739 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whchd\" (UniqueName: \"kubernetes.io/projected/1af3337e-1e4d-4688-ac82-8fb0de212436-kube-api-access-whchd\") pod \"console-76cdd57fc-jcvwt\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.358428 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.358396 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkcst\" (UniqueName: \"kubernetes.io/projected/70e4df2e-82ab-4775-936e-23b3446d8c53-kube-api-access-rkcst\") pod \"monitoring-plugin-76b68cc874-mj47n\" (UID: \"70e4df2e-82ab-4775-936e-23b3446d8c53\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" Jun 07 19:30:41.423597 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.423560 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:41.434779 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.434752 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" Jun 07 19:30:41.541956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.541906 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:41.676476 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.676386 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:41.725730 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.725683 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:41.877972 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.877943 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:41.930921 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:41.930843 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:42.586453 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:42.586360 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:42.695729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:42.695694 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:42.793079 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:42.793041 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:42.894604 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:42.894497 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:44.217038 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:44.217013 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cdd57fc-jcvwt"] Jun 07 19:30:44.219806 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:44.219763 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af3337e_1e4d_4688_ac82_8fb0de212436.slice/crio-236cb55a9e432cd354a59c09090e2b6c2c9893a8b658be1e8410e1147fb8a048 WatchSource:0}: Error finding container 236cb55a9e432cd354a59c09090e2b6c2c9893a8b658be1e8410e1147fb8a048: Status 404 returned error can't find the container with id 236cb55a9e432cd354a59c09090e2b6c2c9893a8b658be1e8410e1147fb8a048 Jun 07 19:30:44.238201 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:44.238177 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-mj47n"] Jun 07 19:30:44.241131 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:30:44.241104 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e4df2e_82ab_4775_936e_23b3446d8c53.slice/crio-a77f81d1aff1e18b99d70d97520c0ccb69d5f6895913005584685f67d7438a58 WatchSource:0}: Error finding container a77f81d1aff1e18b99d70d97520c0ccb69d5f6895913005584685f67d7438a58: Status 404 returned error can't find the container with id a77f81d1aff1e18b99d70d97520c0ccb69d5f6895913005584685f67d7438a58 Jun 07 19:30:44.413458 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:44.413356 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:44.513273 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:44.513229 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:45.104250 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:45.104218 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:45.170994 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:45.170929 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m2zz9" event={"ID":"202249b4-4a9b-4118-94d8-a63381d5d0cd","Type":"ContainerStarted","Data":"8d14984e7584eff760aa1846ed124ec9c510f502231ddae953b0255152382daa"} Jun 07 19:30:45.171181 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:45.171057 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:30:45.172171 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:45.172142 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" event={"ID":"70e4df2e-82ab-4775-936e-23b3446d8c53","Type":"ContainerStarted","Data":"a77f81d1aff1e18b99d70d97520c0ccb69d5f6895913005584685f67d7438a58"} Jun 07 19:30:45.173960 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:45.173932 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cdd57fc-jcvwt" event={"ID":"1af3337e-1e4d-4688-ac82-8fb0de212436","Type":"ContainerStarted","Data":"5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40"} Jun 07 19:30:45.174146 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:45.174101 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cdd57fc-jcvwt" event={"ID":"1af3337e-1e4d-4688-ac82-8fb0de212436","Type":"ContainerStarted","Data":"236cb55a9e432cd354a59c09090e2b6c2c9893a8b658be1e8410e1147fb8a048"} Jun 07 19:30:45.175640 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:45.175616 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7d8dl" event={"ID":"1cc9010f-e635-417d-8648-16996ea61a8d","Type":"ContainerStarted","Data":"ab9cb421cabe6a9eebc8695bfb3fa002407d6b71b5d65214aec18c29567afd1a"} Jun 07 19:30:45.186232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:45.186183 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m2zz9" podStartSLOduration=68.495105004 podStartE2EDuration="1m13.186165161s" totalImagesPullingTime="4.691060157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:45.184657133 +0000 UTC m=+72.859682032" watchObservedRunningTime="2026-06-07 19:30:45.186165161 +0000 UTC m=+72.861190061" Jun 07 19:30:45.194170 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:45.194145 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:45.200207 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:45.200162 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7d8dl" podStartSLOduration=68.324326641 podStartE2EDuration="1m13.200144879s" totalImagesPullingTime="4.875818238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:45.198779506 +0000 UTC m=+72.873804407" watchObservedRunningTime="2026-06-07 19:30:45.200144879 +0000 UTC m=+72.875169778" Jun 07 19:30:45.214394 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:45.214359 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76cdd57fc-jcvwt" podStartSLOduration=4.214347872 podStartE2EDuration="4.214347872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:30:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:45.213665579 +0000 UTC m=+72.888690479" watchObservedRunningTime="2026-06-07 19:30:45.214347872 +0000 UTC m=+72.889372771" Jun 07 19:30:46.180711 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:46.180574 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" event={"ID":"70e4df2e-82ab-4775-936e-23b3446d8c53","Type":"ContainerStarted","Data":"f97ee221d8f172e5372da1d231cae84971f1bac1f1eb5f8aaedd50d06a60bc9c"} Jun 07 19:30:46.181149 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:46.181104 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" Jun 07 19:30:46.185391 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:46.185366 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" Jun 07 19:30:46.196599 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:46.196556 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mj47n" podStartSLOduration=3.841452617 podStartE2EDuration="5.196541406s" totalImagesPullingTime="1.355088789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:30:46.194799161 +0000 UTC m=+73.869824060" watchObservedRunningTime="2026-06-07 19:30:46.196541406 +0000 UTC m=+73.871566303" Jun 07 19:30:46.451620 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:46.451535 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:46.552346 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:46.552311 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:46.628133 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:46.628097 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:49.786454 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:49.786397 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:49.884738 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:49.884704 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:50.156555 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:50.156464 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:50.256938 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:50.256882 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:51.423912 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:51.423879 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:51.424292 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:51.423929 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:51.428649 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:51.428628 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:52.203841 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:52.203815 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:30:52.244724 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:52.244690 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f46c6586f-rbp7c"] Jun 07 19:30:52.340980 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:52.340949 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:52.441574 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:52.441544 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:52.542300 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:52.542268 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:53.225403 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:53.225374 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:53.324817 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:53.324780 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:58.861906 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:58.861874 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:30:58.909546 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:30:58.909514 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:31:02.151322 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.151266 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f5486cf55-bjtw6" podUID="41452ac9-beeb-4a75-9b8f-6b0db298b244" containerName="console" containerID="cri-o://d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741" gracePeriod=15 Jun 07 19:31:02.396197 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.396172 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:31:02.524996 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.524966 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2rvj\" (UniqueName: \"kubernetes.io/projected/41452ac9-beeb-4a75-9b8f-6b0db298b244-kube-api-access-b2rvj\") pod \"41452ac9-beeb-4a75-9b8f-6b0db298b244\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " Jun 07 19:31:02.525194 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.525007 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-serving-cert\") pod \"41452ac9-beeb-4a75-9b8f-6b0db298b244\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " Jun 07 19:31:02.525194 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.525033 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-oauth-config\") pod \"41452ac9-beeb-4a75-9b8f-6b0db298b244\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " Jun 07 19:31:02.525194 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.525053 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-config\") pod \"41452ac9-beeb-4a75-9b8f-6b0db298b244\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " Jun 07 19:31:02.525194 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.525098 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-oauth-serving-cert\") pod \"41452ac9-beeb-4a75-9b8f-6b0db298b244\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " Jun 07 19:31:02.525194 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.525121 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-service-ca\") pod \"41452ac9-beeb-4a75-9b8f-6b0db298b244\" (UID: \"41452ac9-beeb-4a75-9b8f-6b0db298b244\") " Jun 07 19:31:02.525615 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.525585 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-config" (OuterVolumeSpecName: "console-config") pod "41452ac9-beeb-4a75-9b8f-6b0db298b244" (UID: "41452ac9-beeb-4a75-9b8f-6b0db298b244"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:31:02.525682 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.525588 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-service-ca" (OuterVolumeSpecName: "service-ca") pod "41452ac9-beeb-4a75-9b8f-6b0db298b244" (UID: "41452ac9-beeb-4a75-9b8f-6b0db298b244"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:31:02.525682 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.525598 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "41452ac9-beeb-4a75-9b8f-6b0db298b244" (UID: "41452ac9-beeb-4a75-9b8f-6b0db298b244"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:31:02.527498 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.527474 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "41452ac9-beeb-4a75-9b8f-6b0db298b244" (UID: "41452ac9-beeb-4a75-9b8f-6b0db298b244"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:31:02.527604 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.527483 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41452ac9-beeb-4a75-9b8f-6b0db298b244-kube-api-access-b2rvj" (OuterVolumeSpecName: "kube-api-access-b2rvj") pod "41452ac9-beeb-4a75-9b8f-6b0db298b244" (UID: "41452ac9-beeb-4a75-9b8f-6b0db298b244"). InnerVolumeSpecName "kube-api-access-b2rvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:31:02.527604 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.527547 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "41452ac9-beeb-4a75-9b8f-6b0db298b244" (UID: "41452ac9-beeb-4a75-9b8f-6b0db298b244"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:31:02.626684 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.626631 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:02.626684 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.626676 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-oauth-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:02.626684 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.626687 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-console-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:02.626684 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.626695 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-oauth-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:02.626684 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.626704 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41452ac9-beeb-4a75-9b8f-6b0db298b244-service-ca\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:02.626972 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:02.626714 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2rvj\" (UniqueName: \"kubernetes.io/projected/41452ac9-beeb-4a75-9b8f-6b0db298b244-kube-api-access-b2rvj\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:03.240061 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:03.240028 2562 generic.go:356] "Generic (PLEG): container finished" podID="41452ac9-beeb-4a75-9b8f-6b0db298b244" containerID="d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741" exitCode=0 Jun 07 19:31:03.240431 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:03.240078 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5486cf55-bjtw6" Jun 07 19:31:03.240431 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:03.240113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5486cf55-bjtw6" event={"ID":"41452ac9-beeb-4a75-9b8f-6b0db298b244","Type":"ContainerDied","Data":"d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741"} Jun 07 19:31:03.240431 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:03.240167 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5486cf55-bjtw6" event={"ID":"41452ac9-beeb-4a75-9b8f-6b0db298b244","Type":"ContainerDied","Data":"a757aa8f5380682b9ca88d68ea13cfd3ad7d8c63da0136b34e08702ab0d46dfd"} Jun 07 19:31:03.240431 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:03.240206 2562 scope.go:117] "RemoveContainer" containerID="d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741" Jun 07 19:31:03.252700 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:03.252673 2562 scope.go:117] "RemoveContainer" containerID="d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741" Jun 07 19:31:03.253022 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:31:03.253001 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741\": container with ID starting with d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741 not found: ID does not exist" containerID="d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741" Jun 07 19:31:03.253095 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:03.253031 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741"} err="failed to get container status \"d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741\": rpc error: code = NotFound desc = could not find container \"d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741\": container with ID starting with d09fdb0abde41676b16d9d50f85500f2f8d3c70aacc9a3b02e0c0a846c3e4741 not found: ID does not exist" Jun 07 19:31:03.261380 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:03.261358 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5486cf55-bjtw6"] Jun 07 19:31:03.264684 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:03.264659 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5486cf55-bjtw6"] Jun 07 19:31:04.759459 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:04.759406 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41452ac9-beeb-4a75-9b8f-6b0db298b244" path="/var/lib/kubelet/pods/41452ac9-beeb-4a75-9b8f-6b0db298b244/volumes" Jun 07 19:31:08.204692 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:08.204659 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:31:08.384336 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:08.384305 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:31:16.183736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:16.183704 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m2zz9" Jun 07 19:31:17.264213 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.264169 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f46c6586f-rbp7c" podUID="a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" containerName="console" containerID="cri-o://9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc" gracePeriod=15 Jun 07 19:31:17.544913 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.544887 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:31:17.634939 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.634904 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-oauth-serving-cert\") pod \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " Jun 07 19:31:17.635118 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.634951 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-oauth-config\") pod \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " Jun 07 19:31:17.635118 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.634977 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-service-ca\") pod \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " Jun 07 19:31:17.635118 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.634995 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkxs4\" (UniqueName: \"kubernetes.io/projected/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-kube-api-access-zkxs4\") pod \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " Jun 07 19:31:17.635118 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.635014 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-serving-cert\") pod \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " Jun 07 19:31:17.635118 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.635048 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-trusted-ca-bundle\") pod \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " Jun 07 19:31:17.635118 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.635069 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-config\") pod \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\" (UID: \"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e\") " Jun 07 19:31:17.635441 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.635254 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" (UID: "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:31:17.635547 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.635510 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" (UID: "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:31:17.635601 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.635522 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-service-ca" (OuterVolumeSpecName: "service-ca") pod "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" (UID: "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:31:17.635644 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.635614 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-config" (OuterVolumeSpecName: "console-config") pod "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" (UID: "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:31:17.637372 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.637341 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-kube-api-access-zkxs4" (OuterVolumeSpecName: "kube-api-access-zkxs4") pod "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" (UID: "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e"). InnerVolumeSpecName "kube-api-access-zkxs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:31:17.637538 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.637360 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" (UID: "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:31:17.637538 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.637426 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" (UID: "a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:31:17.735940 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.735890 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-oauth-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:17.735940 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.735935 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-oauth-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:17.735940 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.735945 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-service-ca\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:17.735940 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.735953 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkxs4\" (UniqueName: \"kubernetes.io/projected/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-kube-api-access-zkxs4\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:17.736193 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.735962 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:17.736193 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.735971 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-trusted-ca-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:17.736193 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:17.735979 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e-console-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:31:18.296609 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:18.296575 2562 generic.go:356] "Generic (PLEG): container finished" podID="a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" containerID="9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc" exitCode=0 Jun 07 19:31:18.297033 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:18.296623 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f46c6586f-rbp7c" Jun 07 19:31:18.297033 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:18.296664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f46c6586f-rbp7c" event={"ID":"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e","Type":"ContainerDied","Data":"9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc"} Jun 07 19:31:18.297033 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:18.296715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f46c6586f-rbp7c" event={"ID":"a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e","Type":"ContainerDied","Data":"ea1ce437ff11004fd221376aa7ebe745978cbc8fa2680948fb01b3113e672474"} Jun 07 19:31:18.297033 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:18.296743 2562 scope.go:117] "RemoveContainer" containerID="9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc" Jun 07 19:31:18.305195 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:18.305177 2562 scope.go:117] "RemoveContainer" containerID="9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc" Jun 07 19:31:18.305463 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:31:18.305441 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc\": container with ID starting with 9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc not found: ID does not exist" containerID="9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc" Jun 07 19:31:18.305522 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:18.305471 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc"} err="failed to get container status \"9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc\": rpc error: code = NotFound desc = could not find container \"9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc\": container with ID starting with 9b060a435b6665e6fa2f840c0f061d45532276da67d067d1c9a6f7acac7a11cc not found: ID does not exist" Jun 07 19:31:18.316554 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:18.316520 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f46c6586f-rbp7c"] Jun 07 19:31:18.317964 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:18.317943 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f46c6586f-rbp7c"] Jun 07 19:31:18.758730 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:18.758652 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" path="/var/lib/kubelet/pods/a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e/volumes" Jun 07 19:31:23.209040 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:23.208990 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:31:23.255016 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:23.254986 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:31:45.974063 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:45.974023 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:31:46.024542 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:46.024505 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:31:55.540224 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:55.540190 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:31:55.736398 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:31:55.736358 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:03.628955 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.628912 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8555c69555-qqfsp"] Jun 07 19:32:03.629454 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.629273 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41452ac9-beeb-4a75-9b8f-6b0db298b244" containerName="console" Jun 07 19:32:03.629454 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.629292 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="41452ac9-beeb-4a75-9b8f-6b0db298b244" containerName="console" Jun 07 19:32:03.629454 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.629312 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" containerName="console" Jun 07 19:32:03.629454 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.629321 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" containerName="console" Jun 07 19:32:03.629454 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.629381 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3c4f669-e4bf-4b2f-89a4-e90479cb1c2e" containerName="console" Jun 07 19:32:03.629454 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.629393 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="41452ac9-beeb-4a75-9b8f-6b0db298b244" containerName="console" Jun 07 19:32:03.632968 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.632944 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.642822 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.642798 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8555c69555-qqfsp"] Jun 07 19:32:03.676314 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.676278 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:03.773272 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.773237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-service-ca\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.773272 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.773270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gct87\" (UniqueName: \"kubernetes.io/projected/5badecde-17e1-43e2-a2de-e57aeca78592-kube-api-access-gct87\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.773547 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.773306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-serving-cert\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.773547 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.773358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-oauth-config\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.773547 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.773396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-oauth-serving-cert\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.773547 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.773493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-trusted-ca-bundle\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.773705 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.773550 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-console-config\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.776439 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.776395 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:03.874934 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.874902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-service-ca\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.874934 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.874939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gct87\" (UniqueName: \"kubernetes.io/projected/5badecde-17e1-43e2-a2de-e57aeca78592-kube-api-access-gct87\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.875220 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.874967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-serving-cert\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.875220 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.875193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-oauth-config\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.875348 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.875247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-oauth-serving-cert\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.875348 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.875304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-trusted-ca-bundle\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.875474 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.875353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-console-config\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.876486 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.876397 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-service-ca\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.882142 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.877287 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-trusted-ca-bundle\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.882142 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.878266 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-serving-cert\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.883522 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.882882 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gct87\" (UniqueName: \"kubernetes.io/projected/5badecde-17e1-43e2-a2de-e57aeca78592-kube-api-access-gct87\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.883828 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.883808 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-oauth-serving-cert\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.884092 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.884072 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-oauth-config\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.884180 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.884128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-console-config\") pod \"console-8555c69555-qqfsp\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:03.885096 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.885069 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:03.944697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:03.944662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:04.090514 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:04.090489 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8555c69555-qqfsp"] Jun 07 19:32:04.092920 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:32:04.092874 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5badecde_17e1_43e2_a2de_e57aeca78592.slice/crio-a1ce1e05e46399e7ac11a25da493a414b45763b7cb90660434a6041710dbc61e WatchSource:0}: Error finding container a1ce1e05e46399e7ac11a25da493a414b45763b7cb90660434a6041710dbc61e: Status 404 returned error can't find the container with id a1ce1e05e46399e7ac11a25da493a414b45763b7cb90660434a6041710dbc61e Jun 07 19:32:04.430197 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:04.430108 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:04.453198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:04.453167 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8555c69555-qqfsp" event={"ID":"5badecde-17e1-43e2-a2de-e57aeca78592","Type":"ContainerStarted","Data":"532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a"} Jun 07 19:32:04.453354 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:04.453210 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8555c69555-qqfsp" event={"ID":"5badecde-17e1-43e2-a2de-e57aeca78592","Type":"ContainerStarted","Data":"a1ce1e05e46399e7ac11a25da493a414b45763b7cb90660434a6041710dbc61e"} Jun 07 19:32:04.469660 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:04.469612 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8555c69555-qqfsp" podStartSLOduration=1.469596533 podStartE2EDuration="1.469596533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:32:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:32:04.468785514 +0000 UTC m=+152.143810415" watchObservedRunningTime="2026-06-07 19:32:04.469596533 +0000 UTC m=+152.144621432" Jun 07 19:32:04.530470 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:04.530395 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:10.766382 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:10.766345 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:10.824751 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:10.824714 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:13.945532 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:13.945498 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:13.946001 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:13.945596 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:13.950262 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:13.950239 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:14.491022 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.490996 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:14.531298 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.531264 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76cdd57fc-jcvwt"] Jun 07 19:32:14.593863 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.593823 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-566d5496d6-j62dh"] Jun 07 19:32:14.596994 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.596975 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.607882 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.607859 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566d5496d6-j62dh"] Jun 07 19:32:14.761326 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.761253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-oauth-config\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.761326 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.761286 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-serving-cert\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.761326 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.761314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-config\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.761552 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.761374 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-service-ca\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.761552 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.761465 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-oauth-serving-cert\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.761552 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.761494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw2s7\" (UniqueName: \"kubernetes.io/projected/8d8913f5-1680-48f0-8571-b65040f5c3b5-kube-api-access-fw2s7\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.761552 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.761513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-trusted-ca-bundle\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.861830 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.861793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-config\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.861830 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.861833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-service-ca\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.862003 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.861886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-oauth-serving-cert\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.862003 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.861906 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw2s7\" (UniqueName: \"kubernetes.io/projected/8d8913f5-1680-48f0-8571-b65040f5c3b5-kube-api-access-fw2s7\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.862003 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.861923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-trusted-ca-bundle\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.862003 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.861958 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-oauth-config\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.862003 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.861982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-serving-cert\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.862679 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.862652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-oauth-serving-cert\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.862779 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.862652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-config\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.862779 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.862663 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-service-ca\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.862881 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.862858 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-trusted-ca-bundle\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.864452 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.864430 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-serving-cert\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.864452 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.864445 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-oauth-config\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.869351 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.869331 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw2s7\" (UniqueName: \"kubernetes.io/projected/8d8913f5-1680-48f0-8571-b65040f5c3b5-kube-api-access-fw2s7\") pod \"console-566d5496d6-j62dh\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.906399 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.906366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:14.984877 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:14.984786 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:15.030279 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:15.030251 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566d5496d6-j62dh"] Jun 07 19:32:15.032778 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:32:15.032750 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d8913f5_1680_48f0_8571_b65040f5c3b5.slice/crio-7915d14aeffaa1eacddfd131180d3c4546bb2f5ead3bc75aa0ea5171922c768b WatchSource:0}: Error finding container 7915d14aeffaa1eacddfd131180d3c4546bb2f5ead3bc75aa0ea5171922c768b: Status 404 returned error can't find the container with id 7915d14aeffaa1eacddfd131180d3c4546bb2f5ead3bc75aa0ea5171922c768b Jun 07 19:32:15.038979 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:15.038949 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:15.491686 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:15.491589 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566d5496d6-j62dh" event={"ID":"8d8913f5-1680-48f0-8571-b65040f5c3b5","Type":"ContainerStarted","Data":"3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d"} Jun 07 19:32:15.491686 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:15.491643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566d5496d6-j62dh" event={"ID":"8d8913f5-1680-48f0-8571-b65040f5c3b5","Type":"ContainerStarted","Data":"7915d14aeffaa1eacddfd131180d3c4546bb2f5ead3bc75aa0ea5171922c768b"} Jun 07 19:32:15.508219 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:15.508175 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-566d5496d6-j62dh" podStartSLOduration=1.508160503 podStartE2EDuration="1.508160503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:32:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:32:15.506986058 +0000 UTC m=+163.182010958" watchObservedRunningTime="2026-06-07 19:32:15.508160503 +0000 UTC m=+163.183185400" Jun 07 19:32:15.573572 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:15.573542 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:22.656363 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:22.656289 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:22.704321 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:22.704280 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:24.907052 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:24.907011 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:24.907490 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:24.907241 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:24.912633 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:24.912607 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:25.527218 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:25.527191 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:32:25.569615 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:25.569585 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8555c69555-qqfsp"] Jun 07 19:32:25.665495 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:25.665461 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:25.711351 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:25.711320 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:25.766097 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:25.766063 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:25.867597 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:25.867503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:32.587492 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:32.587445 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:32.686117 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:32.686081 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:39.552936 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.552899 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-76cdd57fc-jcvwt" podUID="1af3337e-1e4d-4688-ac82-8fb0de212436" containerName="console" containerID="cri-o://5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40" gracePeriod=15 Jun 07 19:32:39.785845 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.785818 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:32:39.841194 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841113 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-oauth-serving-cert\") pod \"1af3337e-1e4d-4688-ac82-8fb0de212436\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " Jun 07 19:32:39.841194 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841154 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-serving-cert\") pod \"1af3337e-1e4d-4688-ac82-8fb0de212436\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " Jun 07 19:32:39.841410 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841193 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-trusted-ca-bundle\") pod \"1af3337e-1e4d-4688-ac82-8fb0de212436\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " Jun 07 19:32:39.841410 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841222 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-oauth-config\") pod \"1af3337e-1e4d-4688-ac82-8fb0de212436\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " Jun 07 19:32:39.841410 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841251 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-service-ca\") pod \"1af3337e-1e4d-4688-ac82-8fb0de212436\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " Jun 07 19:32:39.841410 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841278 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whchd\" (UniqueName: \"kubernetes.io/projected/1af3337e-1e4d-4688-ac82-8fb0de212436-kube-api-access-whchd\") pod \"1af3337e-1e4d-4688-ac82-8fb0de212436\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " Jun 07 19:32:39.841650 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841454 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-console-config\") pod \"1af3337e-1e4d-4688-ac82-8fb0de212436\" (UID: \"1af3337e-1e4d-4688-ac82-8fb0de212436\") " Jun 07 19:32:39.841650 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841577 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1af3337e-1e4d-4688-ac82-8fb0de212436" (UID: "1af3337e-1e4d-4688-ac82-8fb0de212436"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:32:39.841808 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841778 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1af3337e-1e4d-4688-ac82-8fb0de212436" (UID: "1af3337e-1e4d-4688-ac82-8fb0de212436"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:32:39.841874 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841816 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-service-ca" (OuterVolumeSpecName: "service-ca") pod "1af3337e-1e4d-4688-ac82-8fb0de212436" (UID: "1af3337e-1e4d-4688-ac82-8fb0de212436"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:32:39.841874 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841831 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-oauth-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:39.841981 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.841881 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-console-config" (OuterVolumeSpecName: "console-config") pod "1af3337e-1e4d-4688-ac82-8fb0de212436" (UID: "1af3337e-1e4d-4688-ac82-8fb0de212436"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:32:39.843506 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.843480 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1af3337e-1e4d-4688-ac82-8fb0de212436" (UID: "1af3337e-1e4d-4688-ac82-8fb0de212436"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:32:39.843607 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.843532 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1af3337e-1e4d-4688-ac82-8fb0de212436-kube-api-access-whchd" (OuterVolumeSpecName: "kube-api-access-whchd") pod "1af3337e-1e4d-4688-ac82-8fb0de212436" (UID: "1af3337e-1e4d-4688-ac82-8fb0de212436"). InnerVolumeSpecName "kube-api-access-whchd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:32:39.843607 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.843538 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1af3337e-1e4d-4688-ac82-8fb0de212436" (UID: "1af3337e-1e4d-4688-ac82-8fb0de212436"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:32:39.942280 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.942250 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:39.942280 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.942283 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-trusted-ca-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:39.942493 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.942293 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1af3337e-1e4d-4688-ac82-8fb0de212436-console-oauth-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:39.942493 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.942301 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-service-ca\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:39.942493 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.942311 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whchd\" (UniqueName: \"kubernetes.io/projected/1af3337e-1e4d-4688-ac82-8fb0de212436-kube-api-access-whchd\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:39.942493 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:39.942325 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1af3337e-1e4d-4688-ac82-8fb0de212436-console-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:40.578119 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:40.578085 2562 generic.go:356] "Generic (PLEG): container finished" podID="1af3337e-1e4d-4688-ac82-8fb0de212436" containerID="5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40" exitCode=0 Jun 07 19:32:40.578623 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:40.578136 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cdd57fc-jcvwt" Jun 07 19:32:40.578623 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:40.578147 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cdd57fc-jcvwt" event={"ID":"1af3337e-1e4d-4688-ac82-8fb0de212436","Type":"ContainerDied","Data":"5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40"} Jun 07 19:32:40.578623 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:40.578209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cdd57fc-jcvwt" event={"ID":"1af3337e-1e4d-4688-ac82-8fb0de212436","Type":"ContainerDied","Data":"236cb55a9e432cd354a59c09090e2b6c2c9893a8b658be1e8410e1147fb8a048"} Jun 07 19:32:40.578623 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:40.578228 2562 scope.go:117] "RemoveContainer" containerID="5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40" Jun 07 19:32:40.586529 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:40.586512 2562 scope.go:117] "RemoveContainer" containerID="5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40" Jun 07 19:32:40.586809 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:32:40.586788 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40\": container with ID starting with 5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40 not found: ID does not exist" containerID="5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40" Jun 07 19:32:40.586868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:40.586817 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40"} err="failed to get container status \"5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40\": rpc error: code = NotFound desc = could not find container \"5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40\": container with ID starting with 5b2d53a3fff33830aff3034c4829665d10d821a8c33e5ec28155f58cb9533a40 not found: ID does not exist" Jun 07 19:32:40.597733 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:40.597712 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76cdd57fc-jcvwt"] Jun 07 19:32:40.601013 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:40.600992 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76cdd57fc-jcvwt"] Jun 07 19:32:40.759301 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:40.759272 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1af3337e-1e4d-4688-ac82-8fb0de212436" path="/var/lib/kubelet/pods/1af3337e-1e4d-4688-ac82-8fb0de212436/volumes" Jun 07 19:32:44.079524 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:44.079482 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:32:50.589833 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.589798 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8555c69555-qqfsp" podUID="5badecde-17e1-43e2-a2de-e57aeca78592" containerName="console" containerID="cri-o://532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a" gracePeriod=15 Jun 07 19:32:50.826891 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.826867 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:50.915404 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.915328 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-trusted-ca-bundle\") pod \"5badecde-17e1-43e2-a2de-e57aeca78592\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " Jun 07 19:32:50.915404 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.915365 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-oauth-serving-cert\") pod \"5badecde-17e1-43e2-a2de-e57aeca78592\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " Jun 07 19:32:50.915404 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.915394 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-oauth-config\") pod \"5badecde-17e1-43e2-a2de-e57aeca78592\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " Jun 07 19:32:50.915673 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.915437 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-service-ca\") pod \"5badecde-17e1-43e2-a2de-e57aeca78592\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " Jun 07 19:32:50.915673 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.915471 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-serving-cert\") pod \"5badecde-17e1-43e2-a2de-e57aeca78592\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " Jun 07 19:32:50.915673 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.915489 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-console-config\") pod \"5badecde-17e1-43e2-a2de-e57aeca78592\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " Jun 07 19:32:50.915673 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.915517 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gct87\" (UniqueName: \"kubernetes.io/projected/5badecde-17e1-43e2-a2de-e57aeca78592-kube-api-access-gct87\") pod \"5badecde-17e1-43e2-a2de-e57aeca78592\" (UID: \"5badecde-17e1-43e2-a2de-e57aeca78592\") " Jun 07 19:32:50.915913 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.915878 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5badecde-17e1-43e2-a2de-e57aeca78592" (UID: "5badecde-17e1-43e2-a2de-e57aeca78592"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:32:50.915913 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.915891 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5badecde-17e1-43e2-a2de-e57aeca78592" (UID: "5badecde-17e1-43e2-a2de-e57aeca78592"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:32:50.916049 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.915909 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-console-config" (OuterVolumeSpecName: "console-config") pod "5badecde-17e1-43e2-a2de-e57aeca78592" (UID: "5badecde-17e1-43e2-a2de-e57aeca78592"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:32:50.916049 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.915895 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-service-ca" (OuterVolumeSpecName: "service-ca") pod "5badecde-17e1-43e2-a2de-e57aeca78592" (UID: "5badecde-17e1-43e2-a2de-e57aeca78592"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:32:50.917570 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.917547 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5badecde-17e1-43e2-a2de-e57aeca78592" (UID: "5badecde-17e1-43e2-a2de-e57aeca78592"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:32:50.917646 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.917578 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5badecde-17e1-43e2-a2de-e57aeca78592" (UID: "5badecde-17e1-43e2-a2de-e57aeca78592"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:32:50.917646 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:50.917623 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5badecde-17e1-43e2-a2de-e57aeca78592-kube-api-access-gct87" (OuterVolumeSpecName: "kube-api-access-gct87") pod "5badecde-17e1-43e2-a2de-e57aeca78592" (UID: "5badecde-17e1-43e2-a2de-e57aeca78592"). InnerVolumeSpecName "kube-api-access-gct87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:32:51.016849 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.016822 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gct87\" (UniqueName: \"kubernetes.io/projected/5badecde-17e1-43e2-a2de-e57aeca78592-kube-api-access-gct87\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:51.016849 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.016846 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-trusted-ca-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:51.016849 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.016856 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-oauth-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:51.017051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.016867 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-oauth-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:51.017051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.016875 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-service-ca\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:51.017051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.016883 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5badecde-17e1-43e2-a2de-e57aeca78592-console-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:51.017051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.016892 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5badecde-17e1-43e2-a2de-e57aeca78592-console-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:32:51.616733 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.616690 2562 generic.go:356] "Generic (PLEG): container finished" podID="5badecde-17e1-43e2-a2de-e57aeca78592" containerID="532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a" exitCode=0 Jun 07 19:32:51.617198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.616758 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8555c69555-qqfsp" Jun 07 19:32:51.617198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.616779 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8555c69555-qqfsp" event={"ID":"5badecde-17e1-43e2-a2de-e57aeca78592","Type":"ContainerDied","Data":"532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a"} Jun 07 19:32:51.617198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.616884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8555c69555-qqfsp" event={"ID":"5badecde-17e1-43e2-a2de-e57aeca78592","Type":"ContainerDied","Data":"a1ce1e05e46399e7ac11a25da493a414b45763b7cb90660434a6041710dbc61e"} Jun 07 19:32:51.617198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.616913 2562 scope.go:117] "RemoveContainer" containerID="532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a" Jun 07 19:32:51.625286 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.625268 2562 scope.go:117] "RemoveContainer" containerID="532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a" Jun 07 19:32:51.625540 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:32:51.625518 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a\": container with ID starting with 532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a not found: ID does not exist" containerID="532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a" Jun 07 19:32:51.625603 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.625547 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a"} err="failed to get container status \"532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a\": rpc error: code = NotFound desc = could not find container \"532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a\": container with ID starting with 532aeeff41cf2dec56f130c43d99f3a277b7e18bfb8899d803fa1a9a5ba28c5a not found: ID does not exist" Jun 07 19:32:51.635997 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.635977 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8555c69555-qqfsp"] Jun 07 19:32:51.639586 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:51.639565 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8555c69555-qqfsp"] Jun 07 19:32:52.758447 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:32:52.758397 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5badecde-17e1-43e2-a2de-e57aeca78592" path="/var/lib/kubelet/pods/5badecde-17e1-43e2-a2de-e57aeca78592/volumes" Jun 07 19:33:01.584716 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:01.584682 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:01.673580 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:01.673546 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:02.145264 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.145231 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7"] Jun 07 19:33:02.145541 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.145527 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1af3337e-1e4d-4688-ac82-8fb0de212436" containerName="console" Jun 07 19:33:02.145604 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.145543 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1af3337e-1e4d-4688-ac82-8fb0de212436" containerName="console" Jun 07 19:33:02.145604 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.145551 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5badecde-17e1-43e2-a2de-e57aeca78592" containerName="console" Jun 07 19:33:02.145604 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.145556 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5badecde-17e1-43e2-a2de-e57aeca78592" containerName="console" Jun 07 19:33:02.145604 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.145595 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5badecde-17e1-43e2-a2de-e57aeca78592" containerName="console" Jun 07 19:33:02.145604 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.145604 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1af3337e-1e4d-4688-ac82-8fb0de212436" containerName="console" Jun 07 19:33:02.150295 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.150274 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:02.153203 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.153185 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 19:33:02.153318 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.153187 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 19:33:02.154132 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.154113 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t7bnf\"" Jun 07 19:33:02.162041 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.159729 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7"] Jun 07 19:33:02.198232 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.198200 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:02.198376 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.198245 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:02.198376 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.198328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9qn8\" (UniqueName: \"kubernetes.io/projected/1779e21d-6278-4559-b08f-00460826ce96-kube-api-access-n9qn8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:02.298868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.298831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:02.298999 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.298884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9qn8\" (UniqueName: \"kubernetes.io/projected/1779e21d-6278-4559-b08f-00460826ce96-kube-api-access-n9qn8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:02.298999 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.298911 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:02.299251 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.299218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:02.299287 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.299229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:02.308150 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.308117 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9qn8\" (UniqueName: \"kubernetes.io/projected/1779e21d-6278-4559-b08f-00460826ce96-kube-api-access-n9qn8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:02.465304 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.465215 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:02.591435 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.591340 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7"] Jun 07 19:33:02.596539 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:33:02.596505 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1779e21d_6278_4559_b08f_00460826ce96.slice/crio-f67222688415973bf0d4800fccceecaab6c8caf604355c4fc245a2a48bd5e942 WatchSource:0}: Error finding container f67222688415973bf0d4800fccceecaab6c8caf604355c4fc245a2a48bd5e942: Status 404 returned error can't find the container with id f67222688415973bf0d4800fccceecaab6c8caf604355c4fc245a2a48bd5e942 Jun 07 19:33:02.657453 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.657403 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" event={"ID":"1779e21d-6278-4559-b08f-00460826ce96","Type":"ContainerStarted","Data":"f67222688415973bf0d4800fccceecaab6c8caf604355c4fc245a2a48bd5e942"} Jun 07 19:33:02.908544 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:02.908513 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:08.686597 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:08.686560 2562 generic.go:356] "Generic (PLEG): container finished" podID="1779e21d-6278-4559-b08f-00460826ce96" containerID="fb62c976b3e5a4dfbbfab3a4895f2117c7c4fe0a7e5e8df48389127d9fb70883" exitCode=0 Jun 07 19:33:08.687001 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:08.686643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" event={"ID":"1779e21d-6278-4559-b08f-00460826ce96","Type":"ContainerDied","Data":"fb62c976b3e5a4dfbbfab3a4895f2117c7c4fe0a7e5e8df48389127d9fb70883"} Jun 07 19:33:11.700909 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:11.700873 2562 generic.go:356] "Generic (PLEG): container finished" podID="1779e21d-6278-4559-b08f-00460826ce96" containerID="65bffde721d9a9eb22d66a4bf1f44d96dc2df6476abff1e0c8917ab0150f1028" exitCode=0 Jun 07 19:33:11.701283 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:11.700919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" event={"ID":"1779e21d-6278-4559-b08f-00460826ce96","Type":"ContainerDied","Data":"65bffde721d9a9eb22d66a4bf1f44d96dc2df6476abff1e0c8917ab0150f1028"} Jun 07 19:33:14.667314 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:14.667254 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:18.729318 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:18.729285 2562 generic.go:356] "Generic (PLEG): container finished" podID="1779e21d-6278-4559-b08f-00460826ce96" containerID="03a029e9fe935f33c4f36e2852da8939af69c1c296f125457aa55877cbb4fa74" exitCode=0 Jun 07 19:33:18.729702 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:18.729327 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" event={"ID":"1779e21d-6278-4559-b08f-00460826ce96","Type":"ContainerDied","Data":"03a029e9fe935f33c4f36e2852da8939af69c1c296f125457aa55877cbb4fa74"} Jun 07 19:33:19.851079 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:19.851055 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:19.942758 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:19.942728 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9qn8\" (UniqueName: \"kubernetes.io/projected/1779e21d-6278-4559-b08f-00460826ce96-kube-api-access-n9qn8\") pod \"1779e21d-6278-4559-b08f-00460826ce96\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " Jun 07 19:33:19.942931 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:19.942819 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-bundle\") pod \"1779e21d-6278-4559-b08f-00460826ce96\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " Jun 07 19:33:19.942931 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:19.942881 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-util\") pod \"1779e21d-6278-4559-b08f-00460826ce96\" (UID: \"1779e21d-6278-4559-b08f-00460826ce96\") " Jun 07 19:33:19.943474 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:19.943451 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-bundle" (OuterVolumeSpecName: "bundle") pod "1779e21d-6278-4559-b08f-00460826ce96" (UID: "1779e21d-6278-4559-b08f-00460826ce96"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:33:19.944689 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:19.944655 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1779e21d-6278-4559-b08f-00460826ce96-kube-api-access-n9qn8" (OuterVolumeSpecName: "kube-api-access-n9qn8") pod "1779e21d-6278-4559-b08f-00460826ce96" (UID: "1779e21d-6278-4559-b08f-00460826ce96"). InnerVolumeSpecName "kube-api-access-n9qn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:33:19.947532 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:19.947506 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-util" (OuterVolumeSpecName: "util") pod "1779e21d-6278-4559-b08f-00460826ce96" (UID: "1779e21d-6278-4559-b08f-00460826ce96"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:33:20.043839 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:20.043813 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:33:20.043839 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:20.043836 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1779e21d-6278-4559-b08f-00460826ce96-util\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:33:20.043839 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:20.043845 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9qn8\" (UniqueName: \"kubernetes.io/projected/1779e21d-6278-4559-b08f-00460826ce96-kube-api-access-n9qn8\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:33:20.738167 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:20.738132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" event={"ID":"1779e21d-6278-4559-b08f-00460826ce96","Type":"ContainerDied","Data":"f67222688415973bf0d4800fccceecaab6c8caf604355c4fc245a2a48bd5e942"} Jun 07 19:33:20.738329 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:20.738183 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f67222688415973bf0d4800fccceecaab6c8caf604355c4fc245a2a48bd5e942" Jun 07 19:33:20.738329 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:20.738147 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drcdh7" Jun 07 19:33:22.878190 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:22.878156 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:24.253928 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.253894 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:24.815734 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.815698 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q"] Jun 07 19:33:24.815984 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.815970 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1779e21d-6278-4559-b08f-00460826ce96" containerName="extract" Jun 07 19:33:24.816027 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.815989 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1779e21d-6278-4559-b08f-00460826ce96" containerName="extract" Jun 07 19:33:24.816027 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.816010 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1779e21d-6278-4559-b08f-00460826ce96" containerName="util" Jun 07 19:33:24.816027 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.816015 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1779e21d-6278-4559-b08f-00460826ce96" containerName="util" Jun 07 19:33:24.816115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.816032 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1779e21d-6278-4559-b08f-00460826ce96" containerName="pull" Jun 07 19:33:24.816115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.816038 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1779e21d-6278-4559-b08f-00460826ce96" containerName="pull" Jun 07 19:33:24.816115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.816086 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1779e21d-6278-4559-b08f-00460826ce96" containerName="extract" Jun 07 19:33:24.849825 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.849795 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q"] Jun 07 19:33:24.849999 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.849894 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q" Jun 07 19:33:24.852545 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.852518 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 07 19:33:24.852666 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.852523 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 07 19:33:24.852666 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.852559 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ggvpg\"" Jun 07 19:33:24.982019 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.981945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w46rt\" (UniqueName: \"kubernetes.io/projected/2aea141e-8d3c-4605-a7da-d7b22935c702-kube-api-access-w46rt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t666q\" (UID: \"2aea141e-8d3c-4605-a7da-d7b22935c702\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q" Jun 07 19:33:24.982019 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:24.982003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2aea141e-8d3c-4605-a7da-d7b22935c702-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t666q\" (UID: \"2aea141e-8d3c-4605-a7da-d7b22935c702\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q" Jun 07 19:33:25.083244 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:25.083214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w46rt\" (UniqueName: \"kubernetes.io/projected/2aea141e-8d3c-4605-a7da-d7b22935c702-kube-api-access-w46rt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t666q\" (UID: \"2aea141e-8d3c-4605-a7da-d7b22935c702\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q" Jun 07 19:33:25.083391 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:25.083268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2aea141e-8d3c-4605-a7da-d7b22935c702-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t666q\" (UID: \"2aea141e-8d3c-4605-a7da-d7b22935c702\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q" Jun 07 19:33:25.083620 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:25.083601 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2aea141e-8d3c-4605-a7da-d7b22935c702-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t666q\" (UID: \"2aea141e-8d3c-4605-a7da-d7b22935c702\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q" Jun 07 19:33:25.090889 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:25.090867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w46rt\" (UniqueName: \"kubernetes.io/projected/2aea141e-8d3c-4605-a7da-d7b22935c702-kube-api-access-w46rt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t666q\" (UID: \"2aea141e-8d3c-4605-a7da-d7b22935c702\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q" Jun 07 19:33:25.158865 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:25.158832 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q" Jun 07 19:33:25.310524 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:25.310500 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q"] Jun 07 19:33:25.312274 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:33:25.312241 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aea141e_8d3c_4605_a7da_d7b22935c702.slice/crio-6693d166ca8b541ddde0dc7fc2f6aae3d126afc9733c692ed2ec6fb7eb340d08 WatchSource:0}: Error finding container 6693d166ca8b541ddde0dc7fc2f6aae3d126afc9733c692ed2ec6fb7eb340d08: Status 404 returned error can't find the container with id 6693d166ca8b541ddde0dc7fc2f6aae3d126afc9733c692ed2ec6fb7eb340d08 Jun 07 19:33:25.757850 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:25.757815 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q" event={"ID":"2aea141e-8d3c-4605-a7da-d7b22935c702","Type":"ContainerStarted","Data":"6693d166ca8b541ddde0dc7fc2f6aae3d126afc9733c692ed2ec6fb7eb340d08"} Jun 07 19:33:26.479652 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:26.479617 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:26.531834 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:26.531800 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:27.767673 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:27.767585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q" event={"ID":"2aea141e-8d3c-4605-a7da-d7b22935c702","Type":"ContainerStarted","Data":"120232db45b482f6ee9fe036593f382a956b67c97557552ff93c15ca7691558e"} Jun 07 19:33:27.788738 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:27.788689 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t666q" podStartSLOduration=1.655746873 podStartE2EDuration="3.788674273s" totalImagesPullingTime="2.1329274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:33:27.787303056 +0000 UTC m=+235.462327953" watchObservedRunningTime="2026-06-07 19:33:27.788674273 +0000 UTC m=+235.463699171" Jun 07 19:33:28.184564 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:28.184529 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:28.285352 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:28.285323 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:29.109736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.109708 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk"] Jun 07 19:33:29.111999 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.111982 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:29.114817 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.114792 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 19:33:29.114817 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.114806 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 19:33:29.114975 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.114946 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t7bnf\"" Jun 07 19:33:29.121382 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.121360 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk"] Jun 07 19:33:29.216544 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.216511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:29.216706 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.216562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzqbt\" (UniqueName: \"kubernetes.io/projected/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-kube-api-access-xzqbt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:29.216706 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.216625 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:29.317778 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.317748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:29.317963 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.317786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:29.317963 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.317816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqbt\" (UniqueName: \"kubernetes.io/projected/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-kube-api-access-xzqbt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:29.318181 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.318161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:29.318255 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.318200 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:29.324946 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.324924 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzqbt\" (UniqueName: \"kubernetes.io/projected/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-kube-api-access-xzqbt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:29.421749 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.421676 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:29.542645 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.542517 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk"] Jun 07 19:33:29.544753 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:33:29.544715 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0b3312_e5b4_49a0_b636_d5e3df5188bf.slice/crio-4ff5a3cbdc73b062fcbc73406276d6512e74db36ead017b91fa5f27bc4a500ae WatchSource:0}: Error finding container 4ff5a3cbdc73b062fcbc73406276d6512e74db36ead017b91fa5f27bc4a500ae: Status 404 returned error can't find the container with id 4ff5a3cbdc73b062fcbc73406276d6512e74db36ead017b91fa5f27bc4a500ae Jun 07 19:33:29.776810 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.776780 2562 generic.go:356] "Generic (PLEG): container finished" podID="fe0b3312-e5b4-49a0-b636-d5e3df5188bf" containerID="21aa69b7f5ff43fcca4764e2322e086faefff73f7fdb2dcde3cade1b921551dc" exitCode=0 Jun 07 19:33:29.776948 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.776820 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" event={"ID":"fe0b3312-e5b4-49a0-b636-d5e3df5188bf","Type":"ContainerDied","Data":"21aa69b7f5ff43fcca4764e2322e086faefff73f7fdb2dcde3cade1b921551dc"} Jun 07 19:33:29.776948 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:29.776852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" event={"ID":"fe0b3312-e5b4-49a0-b636-d5e3df5188bf","Type":"ContainerStarted","Data":"4ff5a3cbdc73b062fcbc73406276d6512e74db36ead017b91fa5f27bc4a500ae"} Jun 07 19:33:31.657217 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:31.657188 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:31.786930 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:31.786902 2562 generic.go:356] "Generic (PLEG): container finished" podID="fe0b3312-e5b4-49a0-b636-d5e3df5188bf" containerID="2ebf65375577676e8cdbaa574c023ba40cebe22804161041704887220ced1edd" exitCode=0 Jun 07 19:33:31.787068 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:31.786973 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" event={"ID":"fe0b3312-e5b4-49a0-b636-d5e3df5188bf","Type":"ContainerDied","Data":"2ebf65375577676e8cdbaa574c023ba40cebe22804161041704887220ced1edd"} Jun 07 19:33:32.037396 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:32.037365 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:32.792897 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:32.792864 2562 generic.go:356] "Generic (PLEG): container finished" podID="fe0b3312-e5b4-49a0-b636-d5e3df5188bf" containerID="c611ae381e457570d6c89a6220fb4ff4a019c0d04d34848667417eee9ee7523a" exitCode=0 Jun 07 19:33:32.793271 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:32.792955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" event={"ID":"fe0b3312-e5b4-49a0-b636-d5e3df5188bf","Type":"ContainerDied","Data":"c611ae381e457570d6c89a6220fb4ff4a019c0d04d34848667417eee9ee7523a"} Jun 07 19:33:32.882033 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:32.881997 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:33.081975 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.081933 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:33.131368 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.131334 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:33.420595 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.420516 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-shnhj"] Jun 07 19:33:33.423112 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.423092 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-shnhj" Jun 07 19:33:33.425537 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.425514 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 07 19:33:33.425645 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.425522 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 07 19:33:33.426501 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.426486 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7frnq\"" Jun 07 19:33:33.432791 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.432769 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-shnhj"] Jun 07 19:33:33.552723 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.552687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b5154c2-4375-4d71-b3f3-37e62a53ac27-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-shnhj\" (UID: \"4b5154c2-4375-4d71-b3f3-37e62a53ac27\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-shnhj" Jun 07 19:33:33.552890 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.552776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8jxk\" (UniqueName: \"kubernetes.io/projected/4b5154c2-4375-4d71-b3f3-37e62a53ac27-kube-api-access-m8jxk\") pod \"cert-manager-cainjector-5d99449ffd-shnhj\" (UID: \"4b5154c2-4375-4d71-b3f3-37e62a53ac27\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-shnhj" Jun 07 19:33:33.653150 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.653116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8jxk\" (UniqueName: \"kubernetes.io/projected/4b5154c2-4375-4d71-b3f3-37e62a53ac27-kube-api-access-m8jxk\") pod \"cert-manager-cainjector-5d99449ffd-shnhj\" (UID: \"4b5154c2-4375-4d71-b3f3-37e62a53ac27\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-shnhj" Jun 07 19:33:33.653321 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.653172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b5154c2-4375-4d71-b3f3-37e62a53ac27-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-shnhj\" (UID: \"4b5154c2-4375-4d71-b3f3-37e62a53ac27\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-shnhj" Jun 07 19:33:33.662390 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.662360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b5154c2-4375-4d71-b3f3-37e62a53ac27-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-shnhj\" (UID: \"4b5154c2-4375-4d71-b3f3-37e62a53ac27\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-shnhj" Jun 07 19:33:33.662506 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.662444 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8jxk\" (UniqueName: \"kubernetes.io/projected/4b5154c2-4375-4d71-b3f3-37e62a53ac27-kube-api-access-m8jxk\") pod \"cert-manager-cainjector-5d99449ffd-shnhj\" (UID: \"4b5154c2-4375-4d71-b3f3-37e62a53ac27\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-shnhj" Jun 07 19:33:33.743271 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.743193 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-shnhj" Jun 07 19:33:33.890557 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.890526 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-shnhj"] Jun 07 19:33:33.891000 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:33:33.890975 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b5154c2_4375_4d71_b3f3_37e62a53ac27.slice/crio-d65fd5a71e8106a5d6253bf45daaa15c497f3e1bab589ddc4e4fd83e4b85e90a WatchSource:0}: Error finding container d65fd5a71e8106a5d6253bf45daaa15c497f3e1bab589ddc4e4fd83e4b85e90a: Status 404 returned error can't find the container with id d65fd5a71e8106a5d6253bf45daaa15c497f3e1bab589ddc4e4fd83e4b85e90a Jun 07 19:33:33.929141 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:33.929121 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:34.057954 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.057922 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzqbt\" (UniqueName: \"kubernetes.io/projected/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-kube-api-access-xzqbt\") pod \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " Jun 07 19:33:34.058105 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.057969 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-util\") pod \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " Jun 07 19:33:34.058105 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.057992 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-bundle\") pod \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\" (UID: \"fe0b3312-e5b4-49a0-b636-d5e3df5188bf\") " Jun 07 19:33:34.058432 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.058376 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-bundle" (OuterVolumeSpecName: "bundle") pod "fe0b3312-e5b4-49a0-b636-d5e3df5188bf" (UID: "fe0b3312-e5b4-49a0-b636-d5e3df5188bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:33:34.059948 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.059925 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-kube-api-access-xzqbt" (OuterVolumeSpecName: "kube-api-access-xzqbt") pod "fe0b3312-e5b4-49a0-b636-d5e3df5188bf" (UID: "fe0b3312-e5b4-49a0-b636-d5e3df5188bf"). InnerVolumeSpecName "kube-api-access-xzqbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:33:34.063809 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.063776 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-util" (OuterVolumeSpecName: "util") pod "fe0b3312-e5b4-49a0-b636-d5e3df5188bf" (UID: "fe0b3312-e5b4-49a0-b636-d5e3df5188bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:33:34.158986 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.158958 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzqbt\" (UniqueName: \"kubernetes.io/projected/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-kube-api-access-xzqbt\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:33:34.158986 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.158983 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-util\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:33:34.158986 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.158992 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe0b3312-e5b4-49a0-b636-d5e3df5188bf-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:33:34.804733 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.804667 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-shnhj" event={"ID":"4b5154c2-4375-4d71-b3f3-37e62a53ac27","Type":"ContainerStarted","Data":"d65fd5a71e8106a5d6253bf45daaa15c497f3e1bab589ddc4e4fd83e4b85e90a"} Jun 07 19:33:34.806825 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.806801 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" event={"ID":"fe0b3312-e5b4-49a0-b636-d5e3df5188bf","Type":"ContainerDied","Data":"4ff5a3cbdc73b062fcbc73406276d6512e74db36ead017b91fa5f27bc4a500ae"} Jun 07 19:33:34.806825 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.806828 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7kqqk" Jun 07 19:33:34.807007 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:34.806847 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ff5a3cbdc73b062fcbc73406276d6512e74db36ead017b91fa5f27bc4a500ae" Jun 07 19:33:36.228022 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.227984 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-78f8f"] Jun 07 19:33:36.228435 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.228351 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0b3312-e5b4-49a0-b636-d5e3df5188bf" containerName="util" Jun 07 19:33:36.228435 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.228368 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0b3312-e5b4-49a0-b636-d5e3df5188bf" containerName="util" Jun 07 19:33:36.228435 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.228378 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0b3312-e5b4-49a0-b636-d5e3df5188bf" containerName="pull" Jun 07 19:33:36.228435 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.228384 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0b3312-e5b4-49a0-b636-d5e3df5188bf" containerName="pull" Jun 07 19:33:36.228435 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.228397 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0b3312-e5b4-49a0-b636-d5e3df5188bf" containerName="extract" Jun 07 19:33:36.228435 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.228402 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0b3312-e5b4-49a0-b636-d5e3df5188bf" containerName="extract" Jun 07 19:33:36.228640 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.228475 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0b3312-e5b4-49a0-b636-d5e3df5188bf" containerName="extract" Jun 07 19:33:36.230343 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.230320 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" Jun 07 19:33:36.232739 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.232721 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-pkt4g\"" Jun 07 19:33:36.238920 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.238574 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-78f8f"] Jun 07 19:33:36.375303 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.375251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrljw\" (UniqueName: \"kubernetes.io/projected/642a3148-72f4-429c-83af-c1a07823dab9-kube-api-access-qrljw\") pod \"cert-manager-webhook-7dc76cbb94-78f8f\" (UID: \"642a3148-72f4-429c-83af-c1a07823dab9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" Jun 07 19:33:36.375509 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.375313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/642a3148-72f4-429c-83af-c1a07823dab9-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-78f8f\" (UID: \"642a3148-72f4-429c-83af-c1a07823dab9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" Jun 07 19:33:36.475896 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.475865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrljw\" (UniqueName: \"kubernetes.io/projected/642a3148-72f4-429c-83af-c1a07823dab9-kube-api-access-qrljw\") pod \"cert-manager-webhook-7dc76cbb94-78f8f\" (UID: \"642a3148-72f4-429c-83af-c1a07823dab9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" Jun 07 19:33:36.476022 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.475908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/642a3148-72f4-429c-83af-c1a07823dab9-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-78f8f\" (UID: \"642a3148-72f4-429c-83af-c1a07823dab9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" Jun 07 19:33:36.485696 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.485633 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/642a3148-72f4-429c-83af-c1a07823dab9-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-78f8f\" (UID: \"642a3148-72f4-429c-83af-c1a07823dab9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" Jun 07 19:33:36.485941 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.485918 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrljw\" (UniqueName: \"kubernetes.io/projected/642a3148-72f4-429c-83af-c1a07823dab9-kube-api-access-qrljw\") pod \"cert-manager-webhook-7dc76cbb94-78f8f\" (UID: \"642a3148-72f4-429c-83af-c1a07823dab9\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" Jun 07 19:33:36.541594 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.541552 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" Jun 07 19:33:36.674008 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.673982 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-78f8f"] Jun 07 19:33:36.676468 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:33:36.676436 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod642a3148_72f4_429c_83af_c1a07823dab9.slice/crio-b8d4adb22ad1aa25e38795744cefdeaccf154ab7599da5c3c69e4cf96425e213 WatchSource:0}: Error finding container b8d4adb22ad1aa25e38795744cefdeaccf154ab7599da5c3c69e4cf96425e213: Status 404 returned error can't find the container with id b8d4adb22ad1aa25e38795744cefdeaccf154ab7599da5c3c69e4cf96425e213 Jun 07 19:33:36.816162 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.816121 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-shnhj" event={"ID":"4b5154c2-4375-4d71-b3f3-37e62a53ac27","Type":"ContainerStarted","Data":"2160adece239b1fea8cd52ff3d7d1a7d21cc5cc629ef202927b73c300f249bab"} Jun 07 19:33:36.820690 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.820660 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" event={"ID":"642a3148-72f4-429c-83af-c1a07823dab9","Type":"ContainerStarted","Data":"d8dc5149b470b34bc0624b67bfd21db66399d23238548f893c36505bf123eb48"} Jun 07 19:33:36.820834 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.820700 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" event={"ID":"642a3148-72f4-429c-83af-c1a07823dab9","Type":"ContainerStarted","Data":"b8d4adb22ad1aa25e38795744cefdeaccf154ab7599da5c3c69e4cf96425e213"} Jun 07 19:33:36.820834 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.820721 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" Jun 07 19:33:36.831463 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.831395 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-shnhj" podStartSLOduration=1.313161707 podStartE2EDuration="3.831380184s" totalImagesPullingTime="2.518218477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:33:36.830467103 +0000 UTC m=+244.505492002" watchObservedRunningTime="2026-06-07 19:33:36.831380184 +0000 UTC m=+244.506405082" Jun 07 19:33:36.846399 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:36.846340 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" podStartSLOduration=0.846319728 podStartE2EDuration="846.319728ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:33:36.844286727 +0000 UTC m=+244.519311625" watchObservedRunningTime="2026-06-07 19:33:36.846319728 +0000 UTC m=+244.521344631" Jun 07 19:33:37.082998 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:37.082883 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:37.183362 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:37.183321 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:39.246568 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.246527 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:39.503814 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.503722 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-gmgc6"] Jun 07 19:33:39.505777 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.505756 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gmgc6" Jun 07 19:33:39.508154 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.508133 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4b6b5\"" Jun 07 19:33:39.516261 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.516240 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gmgc6"] Jun 07 19:33:39.685641 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.685611 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:39.701571 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.701537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61f5decb-965b-4f2b-b184-24a017d7c113-bound-sa-token\") pod \"cert-manager-59c77684cc-gmgc6\" (UID: \"61f5decb-965b-4f2b-b184-24a017d7c113\") " pod="cert-manager/cert-manager-59c77684cc-gmgc6" Jun 07 19:33:39.701708 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.701588 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcffn\" (UniqueName: \"kubernetes.io/projected/61f5decb-965b-4f2b-b184-24a017d7c113-kube-api-access-dcffn\") pod \"cert-manager-59c77684cc-gmgc6\" (UID: \"61f5decb-965b-4f2b-b184-24a017d7c113\") " pod="cert-manager/cert-manager-59c77684cc-gmgc6" Jun 07 19:33:39.788815 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.788787 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:39.802831 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.802806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61f5decb-965b-4f2b-b184-24a017d7c113-bound-sa-token\") pod \"cert-manager-59c77684cc-gmgc6\" (UID: \"61f5decb-965b-4f2b-b184-24a017d7c113\") " pod="cert-manager/cert-manager-59c77684cc-gmgc6" Jun 07 19:33:39.802928 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.802850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcffn\" (UniqueName: \"kubernetes.io/projected/61f5decb-965b-4f2b-b184-24a017d7c113-kube-api-access-dcffn\") pod \"cert-manager-59c77684cc-gmgc6\" (UID: \"61f5decb-965b-4f2b-b184-24a017d7c113\") " pod="cert-manager/cert-manager-59c77684cc-gmgc6" Jun 07 19:33:39.810222 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.810194 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61f5decb-965b-4f2b-b184-24a017d7c113-bound-sa-token\") pod \"cert-manager-59c77684cc-gmgc6\" (UID: \"61f5decb-965b-4f2b-b184-24a017d7c113\") " pod="cert-manager/cert-manager-59c77684cc-gmgc6" Jun 07 19:33:39.810389 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.810370 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcffn\" (UniqueName: \"kubernetes.io/projected/61f5decb-965b-4f2b-b184-24a017d7c113-kube-api-access-dcffn\") pod \"cert-manager-59c77684cc-gmgc6\" (UID: \"61f5decb-965b-4f2b-b184-24a017d7c113\") " pod="cert-manager/cert-manager-59c77684cc-gmgc6" Jun 07 19:33:39.815052 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.815036 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gmgc6" Jun 07 19:33:39.934402 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:39.934372 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gmgc6"] Jun 07 19:33:39.936892 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:33:39.936862 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61f5decb_965b_4f2b_b184_24a017d7c113.slice/crio-d394ae944854abb072b67ab8a131a92fe5d2a28c6b50939591280d0ff7f4fef8 WatchSource:0}: Error finding container d394ae944854abb072b67ab8a131a92fe5d2a28c6b50939591280d0ff7f4fef8: Status 404 returned error can't find the container with id d394ae944854abb072b67ab8a131a92fe5d2a28c6b50939591280d0ff7f4fef8 Jun 07 19:33:40.086523 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:40.086405 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:40.839089 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:40.839055 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gmgc6" event={"ID":"61f5decb-965b-4f2b-b184-24a017d7c113","Type":"ContainerStarted","Data":"c4dd848095ea4f620cb71e83d61249a3287b93a361015d17580263b0d470d428"} Jun 07 19:33:40.839089 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:40.839091 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gmgc6" event={"ID":"61f5decb-965b-4f2b-b184-24a017d7c113","Type":"ContainerStarted","Data":"d394ae944854abb072b67ab8a131a92fe5d2a28c6b50939591280d0ff7f4fef8"} Jun 07 19:33:40.854520 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:40.854480 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-gmgc6" podStartSLOduration=1.854465075 podStartE2EDuration="1.854465075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:33:40.852858862 +0000 UTC m=+248.527883760" watchObservedRunningTime="2026-06-07 19:33:40.854465075 +0000 UTC m=+248.529489973" Jun 07 19:33:41.712442 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.712392 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws"] Jun 07 19:33:41.714244 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.714223 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws" Jun 07 19:33:41.715393 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.715360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v5ml\" (UniqueName: \"kubernetes.io/projected/35150e79-29fa-4768-bfa4-f6fd3bba33b3-kube-api-access-2v5ml\") pod \"openshift-lws-operator-fd8ccff4c-hnpws\" (UID: \"35150e79-29fa-4768-bfa4-f6fd3bba33b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws" Jun 07 19:33:41.715501 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.715486 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35150e79-29fa-4768-bfa4-f6fd3bba33b3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hnpws\" (UID: \"35150e79-29fa-4768-bfa4-f6fd3bba33b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws" Jun 07 19:33:41.716696 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.716681 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 07 19:33:41.717746 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.717730 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qgjkr\"" Jun 07 19:33:41.717797 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.717744 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 07 19:33:41.728361 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.728335 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws"] Jun 07 19:33:41.816727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.816694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35150e79-29fa-4768-bfa4-f6fd3bba33b3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hnpws\" (UID: \"35150e79-29fa-4768-bfa4-f6fd3bba33b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws" Jun 07 19:33:41.816887 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.816752 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v5ml\" (UniqueName: \"kubernetes.io/projected/35150e79-29fa-4768-bfa4-f6fd3bba33b3-kube-api-access-2v5ml\") pod \"openshift-lws-operator-fd8ccff4c-hnpws\" (UID: \"35150e79-29fa-4768-bfa4-f6fd3bba33b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws" Jun 07 19:33:41.817054 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.817035 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35150e79-29fa-4768-bfa4-f6fd3bba33b3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hnpws\" (UID: \"35150e79-29fa-4768-bfa4-f6fd3bba33b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws" Jun 07 19:33:41.824175 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:41.824153 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v5ml\" (UniqueName: \"kubernetes.io/projected/35150e79-29fa-4768-bfa4-f6fd3bba33b3-kube-api-access-2v5ml\") pod \"openshift-lws-operator-fd8ccff4c-hnpws\" (UID: \"35150e79-29fa-4768-bfa4-f6fd3bba33b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws" Jun 07 19:33:42.029982 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:42.029954 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws" Jun 07 19:33:42.167398 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:42.166945 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws"] Jun 07 19:33:42.170211 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:33:42.170166 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35150e79_29fa_4768_bfa4_f6fd3bba33b3.slice/crio-06913b115b4409c5396b10e427061381954683de9a2b3d60c92ee3c30dd3230d WatchSource:0}: Error finding container 06913b115b4409c5396b10e427061381954683de9a2b3d60c92ee3c30dd3230d: Status 404 returned error can't find the container with id 06913b115b4409c5396b10e427061381954683de9a2b3d60c92ee3c30dd3230d Jun 07 19:33:42.826281 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:42.826250 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-78f8f" Jun 07 19:33:42.848927 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:42.848865 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws" event={"ID":"35150e79-29fa-4768-bfa4-f6fd3bba33b3","Type":"ContainerStarted","Data":"06913b115b4409c5396b10e427061381954683de9a2b3d60c92ee3c30dd3230d"} Jun 07 19:33:44.859656 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:44.859622 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws" event={"ID":"35150e79-29fa-4768-bfa4-f6fd3bba33b3","Type":"ContainerStarted","Data":"66a780648511a745f4fdd3ad97a6549ccdba21c0367f7eb56811a60e05c4d107"} Jun 07 19:33:44.876802 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:44.876746 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hnpws" podStartSLOduration=2.089498409 podStartE2EDuration="3.876729161s" totalImagesPullingTime="1.787230752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:33:44.875156575 +0000 UTC m=+252.550181485" watchObservedRunningTime="2026-06-07 19:33:44.876729161 +0000 UTC m=+252.551754059" Jun 07 19:33:45.469899 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:45.469863 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:45.570102 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:45.570069 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:47.685638 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:47.685546 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:33:49.540185 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.540152 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5"] Jun 07 19:33:49.543436 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.543404 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:49.545713 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.545695 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 19:33:49.546629 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.546604 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 19:33:49.546629 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.546617 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t7bnf\"" Jun 07 19:33:49.551319 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.551285 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5"] Jun 07 19:33:49.564644 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.564620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smh2n\" (UniqueName: \"kubernetes.io/projected/5c5d302b-705b-4505-aa29-ce5d748fb65a-kube-api-access-smh2n\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:49.564743 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.564655 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:49.564743 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.564689 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:49.665039 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.665005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:49.665195 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.665066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smh2n\" (UniqueName: \"kubernetes.io/projected/5c5d302b-705b-4505-aa29-ce5d748fb65a-kube-api-access-smh2n\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:49.665195 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.665098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:49.665370 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.665351 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:49.665459 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.665440 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:49.674608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.674584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smh2n\" (UniqueName: \"kubernetes.io/projected/5c5d302b-705b-4505-aa29-ce5d748fb65a-kube-api-access-smh2n\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:49.853401 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.853321 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:49.980221 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:49.980196 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5"] Jun 07 19:33:49.982729 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:33:49.982702 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5d302b_705b_4505_aa29_ce5d748fb65a.slice/crio-845c84a15f0c2b78ec7607ce00bd194b45d8752d2d579fbe66cf75dd2ba89e4f WatchSource:0}: Error finding container 845c84a15f0c2b78ec7607ce00bd194b45d8752d2d579fbe66cf75dd2ba89e4f: Status 404 returned error can't find the container with id 845c84a15f0c2b78ec7607ce00bd194b45d8752d2d579fbe66cf75dd2ba89e4f Jun 07 19:33:50.890696 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:50.890658 2562 generic.go:356] "Generic (PLEG): container finished" podID="5c5d302b-705b-4505-aa29-ce5d748fb65a" containerID="946becd5b87031183f76d8b378a40fba8f38fa1e8ca8c378a06ce9401fbae1aa" exitCode=0 Jun 07 19:33:50.891070 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:50.890721 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" event={"ID":"5c5d302b-705b-4505-aa29-ce5d748fb65a","Type":"ContainerDied","Data":"946becd5b87031183f76d8b378a40fba8f38fa1e8ca8c378a06ce9401fbae1aa"} Jun 07 19:33:50.891070 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:50.890763 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" event={"ID":"5c5d302b-705b-4505-aa29-ce5d748fb65a","Type":"ContainerStarted","Data":"845c84a15f0c2b78ec7607ce00bd194b45d8752d2d579fbe66cf75dd2ba89e4f"} Jun 07 19:33:51.896774 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:51.896741 2562 generic.go:356] "Generic (PLEG): container finished" podID="5c5d302b-705b-4505-aa29-ce5d748fb65a" containerID="3e491e861f6b61ebfc8b15d2e7f84471ba1498c4ac7aec150792c1ef8b05e2e7" exitCode=0 Jun 07 19:33:51.897156 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:51.896784 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" event={"ID":"5c5d302b-705b-4505-aa29-ce5d748fb65a","Type":"ContainerDied","Data":"3e491e861f6b61ebfc8b15d2e7f84471ba1498c4ac7aec150792c1ef8b05e2e7"} Jun 07 19:33:52.902946 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:52.902913 2562 generic.go:356] "Generic (PLEG): container finished" podID="5c5d302b-705b-4505-aa29-ce5d748fb65a" containerID="d47dcde1cf465e1f91de1c4ac775b5c7d91cc91fc89f76355467a7abbc565266" exitCode=0 Jun 07 19:33:52.903318 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:52.902998 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" event={"ID":"5c5d302b-705b-4505-aa29-ce5d748fb65a","Type":"ContainerDied","Data":"d47dcde1cf465e1f91de1c4ac775b5c7d91cc91fc89f76355467a7abbc565266"} Jun 07 19:33:54.029731 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.029707 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:54.095590 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.095557 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smh2n\" (UniqueName: \"kubernetes.io/projected/5c5d302b-705b-4505-aa29-ce5d748fb65a-kube-api-access-smh2n\") pod \"5c5d302b-705b-4505-aa29-ce5d748fb65a\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " Jun 07 19:33:54.095590 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.095595 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-util\") pod \"5c5d302b-705b-4505-aa29-ce5d748fb65a\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " Jun 07 19:33:54.095863 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.095616 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-bundle\") pod \"5c5d302b-705b-4505-aa29-ce5d748fb65a\" (UID: \"5c5d302b-705b-4505-aa29-ce5d748fb65a\") " Jun 07 19:33:54.096297 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.096267 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-bundle" (OuterVolumeSpecName: "bundle") pod "5c5d302b-705b-4505-aa29-ce5d748fb65a" (UID: "5c5d302b-705b-4505-aa29-ce5d748fb65a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:33:54.097674 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.097651 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c5d302b-705b-4505-aa29-ce5d748fb65a-kube-api-access-smh2n" (OuterVolumeSpecName: "kube-api-access-smh2n") pod "5c5d302b-705b-4505-aa29-ce5d748fb65a" (UID: "5c5d302b-705b-4505-aa29-ce5d748fb65a"). InnerVolumeSpecName "kube-api-access-smh2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:33:54.101256 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.101219 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-util" (OuterVolumeSpecName: "util") pod "5c5d302b-705b-4505-aa29-ce5d748fb65a" (UID: "5c5d302b-705b-4505-aa29-ce5d748fb65a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:33:54.196471 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.196385 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smh2n\" (UniqueName: \"kubernetes.io/projected/5c5d302b-705b-4505-aa29-ce5d748fb65a-kube-api-access-smh2n\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:33:54.196471 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.196427 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-util\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:33:54.196471 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.196442 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5d302b-705b-4505-aa29-ce5d748fb65a-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:33:54.913678 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.913638 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" event={"ID":"5c5d302b-705b-4505-aa29-ce5d748fb65a","Type":"ContainerDied","Data":"845c84a15f0c2b78ec7607ce00bd194b45d8752d2d579fbe66cf75dd2ba89e4f"} Jun 07 19:33:54.913678 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.913676 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd98gz5" Jun 07 19:33:54.913867 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:33:54.913693 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="845c84a15f0c2b78ec7607ce00bd194b45d8752d2d579fbe66cf75dd2ba89e4f" Jun 07 19:34:01.692342 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:01.692302 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:01.791435 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:01.791387 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:02.036176 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.036140 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:02.136383 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.136346 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:02.294858 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.294777 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:02.517015 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.516976 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:02.619659 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.619570 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:02.655644 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.655608 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx"] Jun 07 19:34:02.655889 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.655878 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5d302b-705b-4505-aa29-ce5d748fb65a" containerName="extract" Jun 07 19:34:02.655936 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.655891 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5d302b-705b-4505-aa29-ce5d748fb65a" containerName="extract" Jun 07 19:34:02.655936 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.655902 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5d302b-705b-4505-aa29-ce5d748fb65a" containerName="pull" Jun 07 19:34:02.655936 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.655907 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5d302b-705b-4505-aa29-ce5d748fb65a" containerName="pull" Jun 07 19:34:02.655936 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.655916 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5d302b-705b-4505-aa29-ce5d748fb65a" containerName="util" Jun 07 19:34:02.655936 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.655921 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5d302b-705b-4505-aa29-ce5d748fb65a" containerName="util" Jun 07 19:34:02.656080 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.655964 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c5d302b-705b-4505-aa29-ce5d748fb65a" containerName="extract" Jun 07 19:34:02.661729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.661706 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.664400 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.664372 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tkxfv\"" Jun 07 19:34:02.664400 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.664377 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 07 19:34:02.664689 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.664673 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 07 19:34:02.664971 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.664954 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 07 19:34:02.665031 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.665006 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 07 19:34:02.675632 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.675607 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx"] Jun 07 19:34:02.750972 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.750927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0eaf737-5fa2-4705-9de5-5771272d6687-tmp\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.751393 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.750979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gn2k\" (UniqueName: \"kubernetes.io/projected/b0eaf737-5fa2-4705-9de5-5771272d6687-kube-api-access-8gn2k\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.751393 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.751027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b0eaf737-5fa2-4705-9de5-5771272d6687-manifests\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.751393 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.751100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0eaf737-5fa2-4705-9de5-5771272d6687-webhook-cert\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.751393 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.751147 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b0eaf737-5fa2-4705-9de5-5771272d6687-apiservice-cert\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.764850 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.764815 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:02.851661 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.851628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b0eaf737-5fa2-4705-9de5-5771272d6687-apiservice-cert\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.851661 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.851671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0eaf737-5fa2-4705-9de5-5771272d6687-tmp\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.851875 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.851698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gn2k\" (UniqueName: \"kubernetes.io/projected/b0eaf737-5fa2-4705-9de5-5771272d6687-kube-api-access-8gn2k\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.851875 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.851732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b0eaf737-5fa2-4705-9de5-5771272d6687-manifests\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.851875 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.851768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0eaf737-5fa2-4705-9de5-5771272d6687-webhook-cert\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.852193 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.852161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b0eaf737-5fa2-4705-9de5-5771272d6687-manifests\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.854034 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.854009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0eaf737-5fa2-4705-9de5-5771272d6687-tmp\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.854441 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.854403 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0eaf737-5fa2-4705-9de5-5771272d6687-webhook-cert\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.854496 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.854403 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b0eaf737-5fa2-4705-9de5-5771272d6687-apiservice-cert\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.859100 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.859080 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gn2k\" (UniqueName: \"kubernetes.io/projected/b0eaf737-5fa2-4705-9de5-5771272d6687-kube-api-access-8gn2k\") pod \"opendatahub-operator-controller-manager-544b9844c8-fnjxx\" (UID: \"b0eaf737-5fa2-4705-9de5-5771272d6687\") " pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:02.865453 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.865429 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:02.966342 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.966248 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:02.972097 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:02.972074 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:03.073013 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:03.072971 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:03.115039 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:03.115008 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx"] Jun 07 19:34:03.123086 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:34:03.122644 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0eaf737_5fa2_4705_9de5_5771272d6687.slice/crio-555f0aff5cb9271c3367d0d92d0460ec30beb4ace9006efbdec256702efede46 WatchSource:0}: Error finding container 555f0aff5cb9271c3367d0d92d0460ec30beb4ace9006efbdec256702efede46: Status 404 returned error can't find the container with id 555f0aff5cb9271c3367d0d92d0460ec30beb4ace9006efbdec256702efede46 Jun 07 19:34:03.182983 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:03.182936 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:03.954184 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:03.954145 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" event={"ID":"b0eaf737-5fa2-4705-9de5-5771272d6687","Type":"ContainerStarted","Data":"555f0aff5cb9271c3367d0d92d0460ec30beb4ace9006efbdec256702efede46"} Jun 07 19:34:05.995661 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:05.995621 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:06.097166 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:06.097131 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:06.969877 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:06.969828 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" event={"ID":"b0eaf737-5fa2-4705-9de5-5771272d6687","Type":"ContainerStarted","Data":"44c88a55147234412d6f4d8e78a07db2fad3b895c4f6de76520b24a39eb78523"} Jun 07 19:34:07.976172 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:07.976138 2562 generic.go:356] "Generic (PLEG): container finished" podID="b0eaf737-5fa2-4705-9de5-5771272d6687" containerID="44c88a55147234412d6f4d8e78a07db2fad3b895c4f6de76520b24a39eb78523" exitCode=0 Jun 07 19:34:07.976624 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:07.976221 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" event={"ID":"b0eaf737-5fa2-4705-9de5-5771272d6687","Type":"ContainerDied","Data":"44c88a55147234412d6f4d8e78a07db2fad3b895c4f6de76520b24a39eb78523"} Jun 07 19:34:08.982317 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:08.982284 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" event={"ID":"b0eaf737-5fa2-4705-9de5-5771272d6687","Type":"ContainerStarted","Data":"0148836fac517d3295be2969816435b2bf472e20ed7c9477c87517e50e20e621"} Jun 07 19:34:08.982703 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:08.982355 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:09.002876 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:09.002832 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" podStartSLOduration=2.913486818 podStartE2EDuration="7.002817437s" totalImagesPullingTime="3.050941222s" totalInitContainerRuntime="1.038389397s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:34:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:34:09.001832376 +0000 UTC m=+276.676857274" watchObservedRunningTime="2026-06-07 19:34:09.002817437 +0000 UTC m=+276.677842334" Jun 07 19:34:19.990152 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:19.990121 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-544b9844c8-fnjxx" Jun 07 19:34:21.454717 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.454681 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:21.547740 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.547706 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:21.654575 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.654543 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:21.729715 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.729624 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:21.733940 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.733912 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x"] Jun 07 19:34:21.738377 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.738357 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" Jun 07 19:34:21.740697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.740674 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 07 19:34:21.740817 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.740703 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jbvtd\"" Jun 07 19:34:21.741783 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.741752 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 07 19:34:21.741783 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.741772 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 07 19:34:21.741964 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.741835 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 07 19:34:21.747146 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.747126 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x"] Jun 07 19:34:21.788656 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.788623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qcf4\" (UniqueName: \"kubernetes.io/projected/0734007c-8c47-4447-9b7f-67d43ef3febc-kube-api-access-7qcf4\") pod \"kube-auth-proxy-d6d9c57f7-bg58x\" (UID: \"0734007c-8c47-4447-9b7f-67d43ef3febc\") " pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" Jun 07 19:34:21.788803 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.788663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0734007c-8c47-4447-9b7f-67d43ef3febc-tmp\") pod \"kube-auth-proxy-d6d9c57f7-bg58x\" (UID: \"0734007c-8c47-4447-9b7f-67d43ef3febc\") " pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" Jun 07 19:34:21.788803 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.788695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0734007c-8c47-4447-9b7f-67d43ef3febc-tls-certs\") pod \"kube-auth-proxy-d6d9c57f7-bg58x\" (UID: \"0734007c-8c47-4447-9b7f-67d43ef3febc\") " pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" Jun 07 19:34:21.890143 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.890105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qcf4\" (UniqueName: \"kubernetes.io/projected/0734007c-8c47-4447-9b7f-67d43ef3febc-kube-api-access-7qcf4\") pod \"kube-auth-proxy-d6d9c57f7-bg58x\" (UID: \"0734007c-8c47-4447-9b7f-67d43ef3febc\") " pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" Jun 07 19:34:21.890327 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.890151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0734007c-8c47-4447-9b7f-67d43ef3febc-tmp\") pod \"kube-auth-proxy-d6d9c57f7-bg58x\" (UID: \"0734007c-8c47-4447-9b7f-67d43ef3febc\") " pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" Jun 07 19:34:21.890327 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.890196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0734007c-8c47-4447-9b7f-67d43ef3febc-tls-certs\") pod \"kube-auth-proxy-d6d9c57f7-bg58x\" (UID: \"0734007c-8c47-4447-9b7f-67d43ef3febc\") " pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" Jun 07 19:34:21.892528 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.892496 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0734007c-8c47-4447-9b7f-67d43ef3febc-tmp\") pod \"kube-auth-proxy-d6d9c57f7-bg58x\" (UID: \"0734007c-8c47-4447-9b7f-67d43ef3febc\") " pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" Jun 07 19:34:21.892678 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.892663 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0734007c-8c47-4447-9b7f-67d43ef3febc-tls-certs\") pod \"kube-auth-proxy-d6d9c57f7-bg58x\" (UID: \"0734007c-8c47-4447-9b7f-67d43ef3febc\") " pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" Jun 07 19:34:21.898942 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.898919 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qcf4\" (UniqueName: \"kubernetes.io/projected/0734007c-8c47-4447-9b7f-67d43ef3febc-kube-api-access-7qcf4\") pod \"kube-auth-proxy-d6d9c57f7-bg58x\" (UID: \"0734007c-8c47-4447-9b7f-67d43ef3febc\") " pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" Jun 07 19:34:21.923864 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:21.923834 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:22.023377 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.023328 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:22.048498 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.048468 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" Jun 07 19:34:22.081823 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.081792 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:22.184481 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.184457 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x"] Jun 07 19:34:22.185970 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:34:22.185945 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0734007c_8c47_4447_9b7f_67d43ef3febc.slice/crio-ebd667b0d8920294f8802ca46fdfbcb69cbaed53c9e678f385ed8185ab9dbb4e WatchSource:0}: Error finding container ebd667b0d8920294f8802ca46fdfbcb69cbaed53c9e678f385ed8185ab9dbb4e: Status 404 returned error can't find the container with id ebd667b0d8920294f8802ca46fdfbcb69cbaed53c9e678f385ed8185ab9dbb4e Jun 07 19:34:22.189315 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.189291 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:22.414201 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.414120 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:22.474668 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.474639 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-lzhs6"] Jun 07 19:34:22.480215 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.480198 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" Jun 07 19:34:22.482549 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.482528 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-mzw5t\"" Jun 07 19:34:22.482657 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.482563 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 07 19:34:22.486669 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.486647 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-lzhs6"] Jun 07 19:34:22.495166 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.495140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5405729f-fc0d-4ab8-af8d-7730984743b1-tls-certs\") pod \"model-serving-api-5dd488fc48-lzhs6\" (UID: \"5405729f-fc0d-4ab8-af8d-7730984743b1\") " pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" Jun 07 19:34:22.495277 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.495200 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkbct\" (UniqueName: \"kubernetes.io/projected/5405729f-fc0d-4ab8-af8d-7730984743b1-kube-api-access-vkbct\") pod \"model-serving-api-5dd488fc48-lzhs6\" (UID: \"5405729f-fc0d-4ab8-af8d-7730984743b1\") " pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" Jun 07 19:34:22.595836 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.595805 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbct\" (UniqueName: \"kubernetes.io/projected/5405729f-fc0d-4ab8-af8d-7730984743b1-kube-api-access-vkbct\") pod \"model-serving-api-5dd488fc48-lzhs6\" (UID: \"5405729f-fc0d-4ab8-af8d-7730984743b1\") " pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" Jun 07 19:34:22.595983 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.595891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5405729f-fc0d-4ab8-af8d-7730984743b1-tls-certs\") pod \"model-serving-api-5dd488fc48-lzhs6\" (UID: \"5405729f-fc0d-4ab8-af8d-7730984743b1\") " pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" Jun 07 19:34:22.596028 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:34:22.595986 2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 07 19:34:22.596061 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:34:22.596046 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5405729f-fc0d-4ab8-af8d-7730984743b1-tls-certs podName:5405729f-fc0d-4ab8-af8d-7730984743b1 nodeName:}" failed. No retries permitted until 2026-06-07 19:34:23.096025433 +0000 UTC m=+290.771050323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5405729f-fc0d-4ab8-af8d-7730984743b1-tls-certs") pod "model-serving-api-5dd488fc48-lzhs6" (UID: "5405729f-fc0d-4ab8-af8d-7730984743b1") : secret "model-serving-api-tls" not found Jun 07 19:34:22.604581 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.604557 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkbct\" (UniqueName: \"kubernetes.io/projected/5405729f-fc0d-4ab8-af8d-7730984743b1-kube-api-access-vkbct\") pod \"model-serving-api-5dd488fc48-lzhs6\" (UID: \"5405729f-fc0d-4ab8-af8d-7730984743b1\") " pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" Jun 07 19:34:22.649572 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.649541 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:22.750606 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:22.750503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:23.048964 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.048919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" event={"ID":"0734007c-8c47-4447-9b7f-67d43ef3febc","Type":"ContainerStarted","Data":"ebd667b0d8920294f8802ca46fdfbcb69cbaed53c9e678f385ed8185ab9dbb4e"} Jun 07 19:34:23.099589 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.099553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5405729f-fc0d-4ab8-af8d-7730984743b1-tls-certs\") pod \"model-serving-api-5dd488fc48-lzhs6\" (UID: \"5405729f-fc0d-4ab8-af8d-7730984743b1\") " pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" Jun 07 19:34:23.102668 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.102639 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5405729f-fc0d-4ab8-af8d-7730984743b1-tls-certs\") pod \"model-serving-api-5dd488fc48-lzhs6\" (UID: \"5405729f-fc0d-4ab8-af8d-7730984743b1\") " pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" Jun 07 19:34:23.391141 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.391049 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" Jun 07 19:34:23.541201 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.541168 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-lzhs6"] Jun 07 19:34:23.545154 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:34:23.545115 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5405729f_fc0d_4ab8_af8d_7730984743b1.slice/crio-31b07ace17324fd1d833c29718d5b5ed51a3fe3a3b10d298e9af5dd807c8050d WatchSource:0}: Error finding container 31b07ace17324fd1d833c29718d5b5ed51a3fe3a3b10d298e9af5dd807c8050d: Status 404 returned error can't find the container with id 31b07ace17324fd1d833c29718d5b5ed51a3fe3a3b10d298e9af5dd807c8050d Jun 07 19:34:23.690773 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.690687 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd"] Jun 07 19:34:23.698234 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.698211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:23.700776 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.700672 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t7bnf\"" Jun 07 19:34:23.701022 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.700879 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 19:34:23.702060 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.701392 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 19:34:23.702060 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.701702 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd"] Jun 07 19:34:23.812252 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.812176 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dntl5\" (UniqueName: \"kubernetes.io/projected/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-kube-api-access-dntl5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:23.812455 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.812272 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:23.812455 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.812346 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:23.913115 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.913062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:23.913299 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.913146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:23.913299 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.913221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dntl5\" (UniqueName: \"kubernetes.io/projected/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-kube-api-access-dntl5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:23.913809 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.913770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:23.913900 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.913843 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:23.921758 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:23.921721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dntl5\" (UniqueName: \"kubernetes.io/projected/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-kube-api-access-dntl5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:24.015575 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:24.015505 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:24.055513 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:24.055471 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" event={"ID":"5405729f-fc0d-4ab8-af8d-7730984743b1","Type":"ContainerStarted","Data":"31b07ace17324fd1d833c29718d5b5ed51a3fe3a3b10d298e9af5dd807c8050d"} Jun 07 19:34:25.141290 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:25.141267 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd"] Jun 07 19:34:25.144232 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:34:25.144205 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b1f408_dc8b_47c5_aefe_7f76ef02ffd2.slice/crio-b022ec13c3dd726676a79607e23ed6c6787f0e3a04686120d84acb91df3744ad WatchSource:0}: Error finding container b022ec13c3dd726676a79607e23ed6c6787f0e3a04686120d84acb91df3744ad: Status 404 returned error can't find the container with id b022ec13c3dd726676a79607e23ed6c6787f0e3a04686120d84acb91df3744ad Jun 07 19:34:26.067110 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:26.067075 2562 generic.go:356] "Generic (PLEG): container finished" podID="07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" containerID="a5ddb55959fb440cc676fe8d42f42660698e266c130675791bcd426378c15a98" exitCode=0 Jun 07 19:34:26.067325 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:26.067162 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" event={"ID":"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2","Type":"ContainerDied","Data":"a5ddb55959fb440cc676fe8d42f42660698e266c130675791bcd426378c15a98"} Jun 07 19:34:26.067325 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:26.067213 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" event={"ID":"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2","Type":"ContainerStarted","Data":"b022ec13c3dd726676a79607e23ed6c6787f0e3a04686120d84acb91df3744ad"} Jun 07 19:34:26.068670 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:26.068648 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" event={"ID":"0734007c-8c47-4447-9b7f-67d43ef3febc","Type":"ContainerStarted","Data":"20a261fee746c868874ef340e2c53f57b5359a9300f30a4d2645daee3b548489"} Jun 07 19:34:26.070079 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:26.070055 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" event={"ID":"5405729f-fc0d-4ab8-af8d-7730984743b1","Type":"ContainerStarted","Data":"4ac1e9afeec8477762478337c92e18a2c56f6062596bf127dbeeac3a77e633b9"} Jun 07 19:34:26.070202 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:26.070187 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" Jun 07 19:34:26.097703 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:26.097659 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" podStartSLOduration=2.064971031 podStartE2EDuration="4.097645554s" totalImagesPullingTime="2.032674523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:34:26.095736136 +0000 UTC m=+293.770761033" watchObservedRunningTime="2026-06-07 19:34:26.097645554 +0000 UTC m=+293.772670451" Jun 07 19:34:26.109803 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:26.109762 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d6d9c57f7-bg58x" podStartSLOduration=2.237232484 podStartE2EDuration="5.1097482s" totalImagesPullingTime="2.872515716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:34:26.109045209 +0000 UTC m=+293.784070108" watchObservedRunningTime="2026-06-07 19:34:26.1097482 +0000 UTC m=+293.784773098" Jun 07 19:34:27.078210 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:27.078112 2562 generic.go:356] "Generic (PLEG): container finished" podID="07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" containerID="5062f776824a19e40d9cbc61655ced5026ec603f161a57fa02a327ec9edbe9e2" exitCode=0 Jun 07 19:34:27.078210 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:27.078180 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" event={"ID":"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2","Type":"ContainerDied","Data":"5062f776824a19e40d9cbc61655ced5026ec603f161a57fa02a327ec9edbe9e2"} Jun 07 19:34:28.090978 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:28.090944 2562 generic.go:356] "Generic (PLEG): container finished" podID="07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" containerID="86c54cb7024599ab705941b6335085f9ea9fc1702af56e4567de45b7d549cd60" exitCode=0 Jun 07 19:34:28.091352 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:28.090984 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" event={"ID":"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2","Type":"ContainerDied","Data":"86c54cb7024599ab705941b6335085f9ea9fc1702af56e4567de45b7d549cd60"} Jun 07 19:34:29.224161 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:29.224132 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:29.259121 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:29.259092 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dntl5\" (UniqueName: \"kubernetes.io/projected/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-kube-api-access-dntl5\") pod \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " Jun 07 19:34:29.259274 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:29.259129 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-util\") pod \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " Jun 07 19:34:29.259274 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:29.259165 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-bundle\") pod \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\" (UID: \"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2\") " Jun 07 19:34:29.260070 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:29.260036 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-bundle" (OuterVolumeSpecName: "bundle") pod "07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" (UID: "07b1f408-dc8b-47c5-aefe-7f76ef02ffd2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:34:29.261149 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:29.261126 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-kube-api-access-dntl5" (OuterVolumeSpecName: "kube-api-access-dntl5") pod "07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" (UID: "07b1f408-dc8b-47c5-aefe-7f76ef02ffd2"). InnerVolumeSpecName "kube-api-access-dntl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:34:29.266791 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:29.266767 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-util" (OuterVolumeSpecName: "util") pod "07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" (UID: "07b1f408-dc8b-47c5-aefe-7f76ef02ffd2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:34:29.359776 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:29.359711 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dntl5\" (UniqueName: \"kubernetes.io/projected/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-kube-api-access-dntl5\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:34:29.359776 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:29.359735 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-util\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:34:29.359776 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:29.359746 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07b1f408-dc8b-47c5-aefe-7f76ef02ffd2-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:34:30.101492 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:30.101452 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" event={"ID":"07b1f408-dc8b-47c5-aefe-7f76ef02ffd2","Type":"ContainerDied","Data":"b022ec13c3dd726676a79607e23ed6c6787f0e3a04686120d84acb91df3744ad"} Jun 07 19:34:30.101492 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:30.101479 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065zlvd" Jun 07 19:34:30.101696 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:30.101508 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b022ec13c3dd726676a79607e23ed6c6787f0e3a04686120d84acb91df3744ad" Jun 07 19:34:32.091168 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.091130 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:32.141907 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.141864 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-4kfbm"] Jun 07 19:34:32.142187 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.142176 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" containerName="pull" Jun 07 19:34:32.142226 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.142189 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" containerName="pull" Jun 07 19:34:32.142226 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.142201 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" containerName="util" Jun 07 19:34:32.142226 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.142207 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" containerName="util" Jun 07 19:34:32.142226 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.142226 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" containerName="extract" Jun 07 19:34:32.142346 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.142232 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" containerName="extract" Jun 07 19:34:32.142346 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.142279 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="07b1f408-dc8b-47c5-aefe-7f76ef02ffd2" containerName="extract" Jun 07 19:34:32.145367 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.145349 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" Jun 07 19:34:32.148261 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.148241 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 07 19:34:32.149315 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.149296 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cvx7n\"" Jun 07 19:34:32.157757 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.157735 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9"] Jun 07 19:34:32.165224 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.163572 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-4kfbm"] Jun 07 19:34:32.165224 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.163700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" Jun 07 19:34:32.166840 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.166817 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 07 19:34:32.166946 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.166851 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-njg6q\"" Jun 07 19:34:32.172217 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.172188 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9"] Jun 07 19:34:32.182936 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.182911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/298eaf22-ad6f-4071-9ec2-8c133301a776-cert\") pod \"kserve-controller-manager-69fc866d76-4kfbm\" (UID: \"298eaf22-ad6f-4071-9ec2-8c133301a776\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" Jun 07 19:34:32.183061 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.182969 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k2v5\" (UniqueName: \"kubernetes.io/projected/298eaf22-ad6f-4071-9ec2-8c133301a776-kube-api-access-2k2v5\") pod \"kserve-controller-manager-69fc866d76-4kfbm\" (UID: \"298eaf22-ad6f-4071-9ec2-8c133301a776\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" Jun 07 19:34:32.283729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.283693 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/298eaf22-ad6f-4071-9ec2-8c133301a776-cert\") pod \"kserve-controller-manager-69fc866d76-4kfbm\" (UID: \"298eaf22-ad6f-4071-9ec2-8c133301a776\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" Jun 07 19:34:32.283932 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.283741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k2v5\" (UniqueName: \"kubernetes.io/projected/298eaf22-ad6f-4071-9ec2-8c133301a776-kube-api-access-2k2v5\") pod \"kserve-controller-manager-69fc866d76-4kfbm\" (UID: \"298eaf22-ad6f-4071-9ec2-8c133301a776\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" Jun 07 19:34:32.283932 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.283773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdgbj\" (UniqueName: \"kubernetes.io/projected/8a92fe1f-d620-4b54-92b6-ceade69fa7ce-kube-api-access-jdgbj\") pod \"llmisvc-controller-manager-864bfd7bc9-4pzt9\" (UID: \"8a92fe1f-d620-4b54-92b6-ceade69fa7ce\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" Jun 07 19:34:32.283932 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.283835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a92fe1f-d620-4b54-92b6-ceade69fa7ce-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4pzt9\" (UID: \"8a92fe1f-d620-4b54-92b6-ceade69fa7ce\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" Jun 07 19:34:32.283932 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:34:32.283874 2562 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 07 19:34:32.284121 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:34:32.283944 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/298eaf22-ad6f-4071-9ec2-8c133301a776-cert podName:298eaf22-ad6f-4071-9ec2-8c133301a776 nodeName:}" failed. No retries permitted until 2026-06-07 19:34:32.783921134 +0000 UTC m=+300.458946010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/298eaf22-ad6f-4071-9ec2-8c133301a776-cert") pod "kserve-controller-manager-69fc866d76-4kfbm" (UID: "298eaf22-ad6f-4071-9ec2-8c133301a776") : secret "kserve-webhook-server-cert" not found Jun 07 19:34:32.293735 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.293714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k2v5\" (UniqueName: \"kubernetes.io/projected/298eaf22-ad6f-4071-9ec2-8c133301a776-kube-api-access-2k2v5\") pod \"kserve-controller-manager-69fc866d76-4kfbm\" (UID: \"298eaf22-ad6f-4071-9ec2-8c133301a776\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" Jun 07 19:34:32.384800 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.384698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdgbj\" (UniqueName: \"kubernetes.io/projected/8a92fe1f-d620-4b54-92b6-ceade69fa7ce-kube-api-access-jdgbj\") pod \"llmisvc-controller-manager-864bfd7bc9-4pzt9\" (UID: \"8a92fe1f-d620-4b54-92b6-ceade69fa7ce\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" Jun 07 19:34:32.384800 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.384753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a92fe1f-d620-4b54-92b6-ceade69fa7ce-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4pzt9\" (UID: \"8a92fe1f-d620-4b54-92b6-ceade69fa7ce\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" Jun 07 19:34:32.385016 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:34:32.384857 2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 07 19:34:32.385016 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:34:32.384925 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a92fe1f-d620-4b54-92b6-ceade69fa7ce-cert podName:8a92fe1f-d620-4b54-92b6-ceade69fa7ce nodeName:}" failed. No retries permitted until 2026-06-07 19:34:32.884906829 +0000 UTC m=+300.559931713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a92fe1f-d620-4b54-92b6-ceade69fa7ce-cert") pod "llmisvc-controller-manager-864bfd7bc9-4pzt9" (UID: "8a92fe1f-d620-4b54-92b6-ceade69fa7ce") : secret "llmisvc-webhook-server-cert" not found Jun 07 19:34:32.401351 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.401322 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdgbj\" (UniqueName: \"kubernetes.io/projected/8a92fe1f-d620-4b54-92b6-ceade69fa7ce-kube-api-access-jdgbj\") pod \"llmisvc-controller-manager-864bfd7bc9-4pzt9\" (UID: \"8a92fe1f-d620-4b54-92b6-ceade69fa7ce\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" Jun 07 19:34:32.717516 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.717437 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:34:32.717723 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.717708 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:34:32.725598 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.725569 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 07 19:34:32.788445 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.788396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/298eaf22-ad6f-4071-9ec2-8c133301a776-cert\") pod \"kserve-controller-manager-69fc866d76-4kfbm\" (UID: \"298eaf22-ad6f-4071-9ec2-8c133301a776\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" Jun 07 19:34:32.790740 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.790609 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/298eaf22-ad6f-4071-9ec2-8c133301a776-cert\") pod \"kserve-controller-manager-69fc866d76-4kfbm\" (UID: \"298eaf22-ad6f-4071-9ec2-8c133301a776\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" Jun 07 19:34:32.889181 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.889143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a92fe1f-d620-4b54-92b6-ceade69fa7ce-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4pzt9\" (UID: \"8a92fe1f-d620-4b54-92b6-ceade69fa7ce\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" Jun 07 19:34:32.891526 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:32.891495 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a92fe1f-d620-4b54-92b6-ceade69fa7ce-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4pzt9\" (UID: \"8a92fe1f-d620-4b54-92b6-ceade69fa7ce\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" Jun 07 19:34:33.058594 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:33.058561 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cvx7n\"" Jun 07 19:34:33.066227 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:33.066201 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" Jun 07 19:34:33.079564 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:33.079541 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-njg6q\"" Jun 07 19:34:33.087559 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:33.087539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" Jun 07 19:34:33.136457 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:33.136330 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:33.249999 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:33.249936 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-4kfbm"] Jun 07 19:34:33.254621 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:34:33.254591 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod298eaf22_ad6f_4071_9ec2_8c133301a776.slice/crio-e2b7cff689bf8ed51d62165430c27dbff9c76e39a86ea74914201cab91d9a0d9 WatchSource:0}: Error finding container e2b7cff689bf8ed51d62165430c27dbff9c76e39a86ea74914201cab91d9a0d9: Status 404 returned error can't find the container with id e2b7cff689bf8ed51d62165430c27dbff9c76e39a86ea74914201cab91d9a0d9 Jun 07 19:34:33.271149 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:33.271108 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9"] Jun 07 19:34:33.272745 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:34:33.272693 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a92fe1f_d620_4b54_92b6_ceade69fa7ce.slice/crio-0811b4f656c06a2b4142c511e45467f7d838ccef73d11c2c5fc098ed8b4df3d5 WatchSource:0}: Error finding container 0811b4f656c06a2b4142c511e45467f7d838ccef73d11c2c5fc098ed8b4df3d5: Status 404 returned error can't find the container with id 0811b4f656c06a2b4142c511e45467f7d838ccef73d11c2c5fc098ed8b4df3d5 Jun 07 19:34:33.341990 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:33.341860 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:33.439686 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:33.439654 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:34.121906 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:34.121852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" event={"ID":"8a92fe1f-d620-4b54-92b6-ceade69fa7ce","Type":"ContainerStarted","Data":"0811b4f656c06a2b4142c511e45467f7d838ccef73d11c2c5fc098ed8b4df3d5"} Jun 07 19:34:34.123196 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:34.123168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" event={"ID":"298eaf22-ad6f-4071-9ec2-8c133301a776","Type":"ContainerStarted","Data":"e2b7cff689bf8ed51d62165430c27dbff9c76e39a86ea74914201cab91d9a0d9"} Jun 07 19:34:36.135335 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:36.135300 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" event={"ID":"298eaf22-ad6f-4071-9ec2-8c133301a776","Type":"ContainerStarted","Data":"010aac8c428c4519830fa7d4b3ba678cdbe026d038dfc068772a010d497fae32"} Jun 07 19:34:36.135802 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:36.135380 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" Jun 07 19:34:36.151259 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:36.151212 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" podStartSLOduration=1.8403266550000001 podStartE2EDuration="4.15119634s" totalImagesPullingTime="2.310869685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:34:36.149385027 +0000 UTC m=+303.824409926" watchObservedRunningTime="2026-06-07 19:34:36.15119634 +0000 UTC m=+303.826221238" Jun 07 19:34:37.049928 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:37.049896 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:37.082755 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:37.082729 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-lzhs6" Jun 07 19:34:37.141275 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:37.141239 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" event={"ID":"8a92fe1f-d620-4b54-92b6-ceade69fa7ce","Type":"ContainerStarted","Data":"b0592aeaa3b693e35691b2f35f0645dea8a271e12b8ec3b222c80908383196cd"} Jun 07 19:34:37.141723 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:37.141449 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" Jun 07 19:34:37.143638 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:37.143608 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:37.167101 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:37.167055 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" podStartSLOduration=2.238100161 podStartE2EDuration="5.167038015s" totalImagesPullingTime="2.928937854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:34:37.163987697 +0000 UTC m=+304.839012594" watchObservedRunningTime="2026-06-07 19:34:37.167038015 +0000 UTC m=+304.842062914" Jun 07 19:34:38.047534 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.047495 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:38.105236 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.105202 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss"] Jun 07 19:34:38.108956 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.108935 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:38.112200 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.112179 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 19:34:38.113094 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.113070 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t7bnf\"" Jun 07 19:34:38.113224 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.113072 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 19:34:38.140687 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.140651 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss"] Jun 07 19:34:38.189481 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.189443 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:38.240520 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.240489 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtt89\" (UniqueName: \"kubernetes.io/projected/f64b7db8-87a1-415f-a525-77cb98d6fbff-kube-api-access-rtt89\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:38.240698 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.240526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:38.240698 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.240636 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:38.341848 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.341761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:38.341848 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.341825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtt89\" (UniqueName: \"kubernetes.io/projected/f64b7db8-87a1-415f-a525-77cb98d6fbff-kube-api-access-rtt89\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:38.341848 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.341848 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:38.342221 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.342197 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:38.342288 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.342206 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:38.349620 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.349594 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtt89\" (UniqueName: \"kubernetes.io/projected/f64b7db8-87a1-415f-a525-77cb98d6fbff-kube-api-access-rtt89\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:38.419786 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.419744 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:38.561504 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.561479 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss"] Jun 07 19:34:38.563227 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:34:38.563198 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf64b7db8_87a1_415f_a525_77cb98d6fbff.slice/crio-ad1ba184815a8a557442174bae44110f75116ee3c840b3b2fedcda32de8b3a5c WatchSource:0}: Error finding container ad1ba184815a8a557442174bae44110f75116ee3c840b3b2fedcda32de8b3a5c: Status 404 returned error can't find the container with id ad1ba184815a8a557442174bae44110f75116ee3c840b3b2fedcda32de8b3a5c Jun 07 19:34:38.723447 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.723398 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:38.989091 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:38.989015 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:39.157325 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.157291 2562 generic.go:356] "Generic (PLEG): container finished" podID="f64b7db8-87a1-415f-a525-77cb98d6fbff" containerID="b1273a5e892fbfe9ff08fadefb05f961b950a219fa6c3093c6fe7d924647f8fe" exitCode=0 Jun 07 19:34:39.157528 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.157350 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" event={"ID":"f64b7db8-87a1-415f-a525-77cb98d6fbff","Type":"ContainerDied","Data":"b1273a5e892fbfe9ff08fadefb05f961b950a219fa6c3093c6fe7d924647f8fe"} Jun 07 19:34:39.157528 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.157395 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" event={"ID":"f64b7db8-87a1-415f-a525-77cb98d6fbff","Type":"ContainerStarted","Data":"ad1ba184815a8a557442174bae44110f75116ee3c840b3b2fedcda32de8b3a5c"} Jun 07 19:34:39.158679 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.158621 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 19:34:39.343349 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.343306 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:39.615168 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.615094 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v"] Jun 07 19:34:39.678329 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.678301 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v"] Jun 07 19:34:39.678511 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.678435 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" Jun 07 19:34:39.681275 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.681256 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-mg2s8\"" Jun 07 19:34:39.681569 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.681555 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 07 19:34:39.681813 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.681799 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 07 19:34:39.754985 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.754957 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kc7l\" (UniqueName: \"kubernetes.io/projected/691af11f-869b-4d94-9171-3aebe539bce5-kube-api-access-4kc7l\") pod \"servicemesh-operator3-57f65f65fb-l2j2v\" (UID: \"691af11f-869b-4d94-9171-3aebe539bce5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" Jun 07 19:34:39.755121 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.754990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/691af11f-869b-4d94-9171-3aebe539bce5-operator-config\") pod \"servicemesh-operator3-57f65f65fb-l2j2v\" (UID: \"691af11f-869b-4d94-9171-3aebe539bce5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" Jun 07 19:34:39.855735 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.855699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kc7l\" (UniqueName: \"kubernetes.io/projected/691af11f-869b-4d94-9171-3aebe539bce5-kube-api-access-4kc7l\") pod \"servicemesh-operator3-57f65f65fb-l2j2v\" (UID: \"691af11f-869b-4d94-9171-3aebe539bce5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" Jun 07 19:34:39.855735 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.855733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/691af11f-869b-4d94-9171-3aebe539bce5-operator-config\") pod \"servicemesh-operator3-57f65f65fb-l2j2v\" (UID: \"691af11f-869b-4d94-9171-3aebe539bce5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" Jun 07 19:34:39.858274 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.858244 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/691af11f-869b-4d94-9171-3aebe539bce5-operator-config\") pod \"servicemesh-operator3-57f65f65fb-l2j2v\" (UID: \"691af11f-869b-4d94-9171-3aebe539bce5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" Jun 07 19:34:39.863996 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.863972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kc7l\" (UniqueName: \"kubernetes.io/projected/691af11f-869b-4d94-9171-3aebe539bce5-kube-api-access-4kc7l\") pod \"servicemesh-operator3-57f65f65fb-l2j2v\" (UID: \"691af11f-869b-4d94-9171-3aebe539bce5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" Jun 07 19:34:39.987137 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:39.987050 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" Jun 07 19:34:40.138859 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:40.138836 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v"] Jun 07 19:34:40.140492 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:34:40.140468 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691af11f_869b_4d94_9171_3aebe539bce5.slice/crio-2cb9e47402d1c45debca04de4f6292e6c41513a891d8a125e2e37c071573962d WatchSource:0}: Error finding container 2cb9e47402d1c45debca04de4f6292e6c41513a891d8a125e2e37c071573962d: Status 404 returned error can't find the container with id 2cb9e47402d1c45debca04de4f6292e6c41513a891d8a125e2e37c071573962d Jun 07 19:34:40.163386 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:40.163362 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" event={"ID":"691af11f-869b-4d94-9171-3aebe539bce5","Type":"ContainerStarted","Data":"2cb9e47402d1c45debca04de4f6292e6c41513a891d8a125e2e37c071573962d"} Jun 07 19:34:41.171477 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:41.171440 2562 generic.go:356] "Generic (PLEG): container finished" podID="f64b7db8-87a1-415f-a525-77cb98d6fbff" containerID="68c87adaffc368c5aa798c227f60ba285d2c5efe6010f0bd1ae05611bb50c756" exitCode=0 Jun 07 19:34:41.171950 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:41.171513 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" event={"ID":"f64b7db8-87a1-415f-a525-77cb98d6fbff","Type":"ContainerDied","Data":"68c87adaffc368c5aa798c227f60ba285d2c5efe6010f0bd1ae05611bb50c756"} Jun 07 19:34:42.179566 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:42.179533 2562 generic.go:356] "Generic (PLEG): container finished" podID="f64b7db8-87a1-415f-a525-77cb98d6fbff" containerID="327cbb78702e4843668a0372be17d0cf5d5403982d40f1f7ef88535b83bb2ed5" exitCode=0 Jun 07 19:34:42.179991 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:42.179596 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" event={"ID":"f64b7db8-87a1-415f-a525-77cb98d6fbff","Type":"ContainerDied","Data":"327cbb78702e4843668a0372be17d0cf5d5403982d40f1f7ef88535b83bb2ed5"} Jun 07 19:34:43.186513 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.186400 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" event={"ID":"691af11f-869b-4d94-9171-3aebe539bce5","Type":"ContainerStarted","Data":"bbdec8734ea87457d0048736a113986e9a1c2db789bfa65d7d2e6e9d4906c646"} Jun 07 19:34:43.186951 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.186820 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" Jun 07 19:34:43.209390 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.209333 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" podStartSLOduration=1.542519103 podStartE2EDuration="4.209311629s" totalImagesPullingTime="2.666792526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:34:43.205862391 +0000 UTC m=+310.880887290" watchObservedRunningTime="2026-06-07 19:34:43.209311629 +0000 UTC m=+310.884336529" Jun 07 19:34:43.324538 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.324515 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:43.485681 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.485596 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-util\") pod \"f64b7db8-87a1-415f-a525-77cb98d6fbff\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " Jun 07 19:34:43.485681 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.485672 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtt89\" (UniqueName: \"kubernetes.io/projected/f64b7db8-87a1-415f-a525-77cb98d6fbff-kube-api-access-rtt89\") pod \"f64b7db8-87a1-415f-a525-77cb98d6fbff\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " Jun 07 19:34:43.485870 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.485725 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-bundle\") pod \"f64b7db8-87a1-415f-a525-77cb98d6fbff\" (UID: \"f64b7db8-87a1-415f-a525-77cb98d6fbff\") " Jun 07 19:34:43.486577 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.486552 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-bundle" (OuterVolumeSpecName: "bundle") pod "f64b7db8-87a1-415f-a525-77cb98d6fbff" (UID: "f64b7db8-87a1-415f-a525-77cb98d6fbff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:34:43.487769 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.487742 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f64b7db8-87a1-415f-a525-77cb98d6fbff-kube-api-access-rtt89" (OuterVolumeSpecName: "kube-api-access-rtt89") pod "f64b7db8-87a1-415f-a525-77cb98d6fbff" (UID: "f64b7db8-87a1-415f-a525-77cb98d6fbff"). InnerVolumeSpecName "kube-api-access-rtt89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:34:43.492949 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.492920 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-util" (OuterVolumeSpecName: "util") pod "f64b7db8-87a1-415f-a525-77cb98d6fbff" (UID: "f64b7db8-87a1-415f-a525-77cb98d6fbff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:34:43.586292 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.586258 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-util\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:34:43.586292 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.586290 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtt89\" (UniqueName: \"kubernetes.io/projected/f64b7db8-87a1-415f-a525-77cb98d6fbff-kube-api-access-rtt89\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:34:43.586514 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:43.586304 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f64b7db8-87a1-415f-a525-77cb98d6fbff-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:34:44.194234 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:44.194205 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" Jun 07 19:34:44.194678 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:44.194231 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avmcss" event={"ID":"f64b7db8-87a1-415f-a525-77cb98d6fbff","Type":"ContainerDied","Data":"ad1ba184815a8a557442174bae44110f75116ee3c840b3b2fedcda32de8b3a5c"} Jun 07 19:34:44.194678 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:44.194279 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad1ba184815a8a557442174bae44110f75116ee3c840b3b2fedcda32de8b3a5c" Jun 07 19:34:49.125929 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.125890 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7"] Jun 07 19:34:49.126343 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.126326 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64b7db8-87a1-415f-a525-77cb98d6fbff" containerName="pull" Jun 07 19:34:49.126382 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.126347 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64b7db8-87a1-415f-a525-77cb98d6fbff" containerName="pull" Jun 07 19:34:49.126382 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.126379 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64b7db8-87a1-415f-a525-77cb98d6fbff" containerName="extract" Jun 07 19:34:49.126456 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.126388 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64b7db8-87a1-415f-a525-77cb98d6fbff" containerName="extract" Jun 07 19:34:49.126456 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.126402 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64b7db8-87a1-415f-a525-77cb98d6fbff" containerName="util" Jun 07 19:34:49.126456 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.126427 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64b7db8-87a1-415f-a525-77cb98d6fbff" containerName="util" Jun 07 19:34:49.126551 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.126514 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64b7db8-87a1-415f-a525-77cb98d6fbff" containerName="extract" Jun 07 19:34:49.129572 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.129555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.132077 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.132054 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 07 19:34:49.133476 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.133457 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 07 19:34:49.133601 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.133579 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gd2rf\"" Jun 07 19:34:49.133668 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.133653 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 07 19:34:49.134057 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.134040 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 07 19:34:49.142544 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.142518 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:49.143083 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.143065 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7"] Jun 07 19:34:49.231664 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.231635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.231800 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.231691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eaf808f2-397c-4553-802f-2d695f1ae99f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.231800 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.231760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.231800 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.231789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89qss\" (UniqueName: \"kubernetes.io/projected/eaf808f2-397c-4553-802f-2d695f1ae99f-kube-api-access-89qss\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.231913 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.231824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaf808f2-397c-4553-802f-2d695f1ae99f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.231913 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.231850 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.231913 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.231867 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.234539 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.234516 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:49.332465 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.332393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eaf808f2-397c-4553-802f-2d695f1ae99f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.332465 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.332470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.332713 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.332626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89qss\" (UniqueName: \"kubernetes.io/projected/eaf808f2-397c-4553-802f-2d695f1ae99f-kube-api-access-89qss\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.332713 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.332688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaf808f2-397c-4553-802f-2d695f1ae99f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.332819 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.332719 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.332819 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.332746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.332819 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.332786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.333074 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.333052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.334902 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.334859 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaf808f2-397c-4553-802f-2d695f1ae99f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.335021 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.334996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eaf808f2-397c-4553-802f-2d695f1ae99f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.335099 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.335079 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.335324 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.335309 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.340354 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.340320 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaf808f2-397c-4553-802f-2d695f1ae99f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.341803 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.341775 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89qss\" (UniqueName: \"kubernetes.io/projected/eaf808f2-397c-4553-802f-2d695f1ae99f-kube-api-access-89qss\") pod \"istiod-openshift-gateway-75c67f8887-6xrv7\" (UID: \"eaf808f2-397c-4553-802f-2d695f1ae99f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.439362 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.439281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:49.506032 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.505992 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:49.577527 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.577359 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7"] Jun 07 19:34:49.578974 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.578921 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:49.580003 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:34:49.579979 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf808f2_397c_4553_802f_2d695f1ae99f.slice/crio-077d79ed360e84bba84e3aa6519a6b211c71665970e82fc313c4c96f916bf899 WatchSource:0}: Error finding container 077d79ed360e84bba84e3aa6519a6b211c71665970e82fc313c4c96f916bf899: Status 404 returned error can't find the container with id 077d79ed360e84bba84e3aa6519a6b211c71665970e82fc313c4c96f916bf899 Jun 07 19:34:49.784320 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:49.784282 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:50.224732 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:50.224656 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" event={"ID":"eaf808f2-397c-4553-802f-2d695f1ae99f","Type":"ContainerStarted","Data":"077d79ed360e84bba84e3aa6519a6b211c71665970e82fc313c4c96f916bf899"} Jun 07 19:34:52.198086 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:52.198036 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 07 19:34:52.198384 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:52.198101 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 07 19:34:52.759059 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:52.759025 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:52.807711 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:52.807668 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:53.055881 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.055850 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:53.241897 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.241847 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" event={"ID":"eaf808f2-397c-4553-802f-2d695f1ae99f","Type":"ContainerStarted","Data":"c153dfa6601026b47c398b5574e2eca50b665224bcaf7063388e3b570f87eae8"} Jun 07 19:34:53.242364 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.242023 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:53.243897 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.243878 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" Jun 07 19:34:53.249770 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.249739 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:53.263395 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.263359 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6xrv7" podStartSLOduration=1.647350317 podStartE2EDuration="4.263346968s" totalImagesPullingTime="2.615996651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:34:53.261812629 +0000 UTC m=+320.936837538" watchObservedRunningTime="2026-06-07 19:34:53.263346968 +0000 UTC m=+320.938371865" Jun 07 19:34:53.351001 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.350916 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:53.529250 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.528837 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-68c5d99799-998hf"] Jun 07 19:34:53.532510 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.532481 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-68c5d99799-998hf" Jun 07 19:34:53.534949 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.534927 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9gsqb\"" Jun 07 19:34:53.535070 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.535006 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 07 19:34:53.542862 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.542839 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-68c5d99799-998hf"] Jun 07 19:34:53.557127 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.557096 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:53.672857 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.672785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/57449cbe-7f17-4116-abde-4f5f950bfc12-redirect-config\") pod \"dashboard-redirect-68c5d99799-998hf\" (UID: \"57449cbe-7f17-4116-abde-4f5f950bfc12\") " pod="opendatahub/dashboard-redirect-68c5d99799-998hf" Jun 07 19:34:53.672857 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.672830 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4fnk\" (UniqueName: \"kubernetes.io/projected/57449cbe-7f17-4116-abde-4f5f950bfc12-kube-api-access-m4fnk\") pod \"dashboard-redirect-68c5d99799-998hf\" (UID: \"57449cbe-7f17-4116-abde-4f5f950bfc12\") " pod="opendatahub/dashboard-redirect-68c5d99799-998hf" Jun 07 19:34:53.773397 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.773356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/57449cbe-7f17-4116-abde-4f5f950bfc12-redirect-config\") pod \"dashboard-redirect-68c5d99799-998hf\" (UID: \"57449cbe-7f17-4116-abde-4f5f950bfc12\") " pod="opendatahub/dashboard-redirect-68c5d99799-998hf" Jun 07 19:34:53.773610 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.773450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4fnk\" (UniqueName: \"kubernetes.io/projected/57449cbe-7f17-4116-abde-4f5f950bfc12-kube-api-access-m4fnk\") pod \"dashboard-redirect-68c5d99799-998hf\" (UID: \"57449cbe-7f17-4116-abde-4f5f950bfc12\") " pod="opendatahub/dashboard-redirect-68c5d99799-998hf" Jun 07 19:34:53.774277 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.774257 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/57449cbe-7f17-4116-abde-4f5f950bfc12-redirect-config\") pod \"dashboard-redirect-68c5d99799-998hf\" (UID: \"57449cbe-7f17-4116-abde-4f5f950bfc12\") " pod="opendatahub/dashboard-redirect-68c5d99799-998hf" Jun 07 19:34:53.781525 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.781498 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4fnk\" (UniqueName: \"kubernetes.io/projected/57449cbe-7f17-4116-abde-4f5f950bfc12-kube-api-access-m4fnk\") pod \"dashboard-redirect-68c5d99799-998hf\" (UID: \"57449cbe-7f17-4116-abde-4f5f950bfc12\") " pod="opendatahub/dashboard-redirect-68c5d99799-998hf" Jun 07 19:34:53.843534 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.843501 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-68c5d99799-998hf" Jun 07 19:34:53.979801 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:53.979776 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-68c5d99799-998hf"] Jun 07 19:34:53.982152 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:34:53.982126 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57449cbe_7f17_4116_abde_4f5f950bfc12.slice/crio-2c25ee51cebec5fa779e0366156682f929c3addaa20105689e96d1fa59ca8212 WatchSource:0}: Error finding container 2c25ee51cebec5fa779e0366156682f929c3addaa20105689e96d1fa59ca8212: Status 404 returned error can't find the container with id 2c25ee51cebec5fa779e0366156682f929c3addaa20105689e96d1fa59ca8212 Jun 07 19:34:54.167491 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:54.167454 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:54.247311 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:54.247230 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-68c5d99799-998hf" event={"ID":"57449cbe-7f17-4116-abde-4f5f950bfc12","Type":"ContainerStarted","Data":"2c25ee51cebec5fa779e0366156682f929c3addaa20105689e96d1fa59ca8212"} Jun 07 19:34:54.268014 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:54.267985 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:34:55.202222 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:55.202185 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-l2j2v" Jun 07 19:34:57.266598 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:57.266558 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-68c5d99799-998hf" event={"ID":"57449cbe-7f17-4116-abde-4f5f950bfc12","Type":"ContainerStarted","Data":"8bf66a7037ca1faf9fd71f1983c647174ec8bd6d249a96dc2bbdfde453ff9859"} Jun 07 19:34:57.283715 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:34:57.283666 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-68c5d99799-998hf" podStartSLOduration=2.010295795 podStartE2EDuration="4.28365192s" totalImagesPullingTime="2.273356125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:34:57.282284962 +0000 UTC m=+324.957309860" watchObservedRunningTime="2026-06-07 19:34:57.28365192 +0000 UTC m=+324.958676818" Jun 07 19:35:07.146804 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:07.146772 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-4kfbm" Jun 07 19:35:08.151985 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:08.151957 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4pzt9" Jun 07 19:35:23.086971 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:23.086881 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:35:23.178729 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:23.178689 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:35:23.263165 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:23.263091 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:35:23.803851 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:23.803820 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dt4d2"] Jun 07 19:35:23.807081 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:23.807064 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" Jun 07 19:35:23.809382 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:23.809358 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 19:35:23.810381 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:23.810364 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-s27mk\"" Jun 07 19:35:23.810525 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:23.810400 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 19:35:23.814124 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:23.814104 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dt4d2"] Jun 07 19:35:23.925401 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:23.925362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5mfw\" (UniqueName: \"kubernetes.io/projected/7ceef642-b122-42d4-8a5b-6661b34b8715-kube-api-access-f5mfw\") pod \"kuadrant-operator-catalog-dt4d2\" (UID: \"7ceef642-b122-42d4-8a5b-6661b34b8715\") " pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" Jun 07 19:35:24.025859 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:24.025826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5mfw\" (UniqueName: \"kubernetes.io/projected/7ceef642-b122-42d4-8a5b-6661b34b8715-kube-api-access-f5mfw\") pod \"kuadrant-operator-catalog-dt4d2\" (UID: \"7ceef642-b122-42d4-8a5b-6661b34b8715\") " pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" Jun 07 19:35:24.026505 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:24.026473 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:35:24.033152 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:24.033130 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5mfw\" (UniqueName: \"kubernetes.io/projected/7ceef642-b122-42d4-8a5b-6661b34b8715-kube-api-access-f5mfw\") pod \"kuadrant-operator-catalog-dt4d2\" (UID: \"7ceef642-b122-42d4-8a5b-6661b34b8715\") " pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" Jun 07 19:35:24.117272 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:24.117186 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" Jun 07 19:35:24.225230 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:24.225107 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:35:24.253443 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:24.253396 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dt4d2"] Jun 07 19:35:24.254923 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:35:24.254893 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ceef642_b122_42d4_8a5b_6661b34b8715.slice/crio-07060e349504758926afb659305739836ae536b42468263091caacff77e609be WatchSource:0}: Error finding container 07060e349504758926afb659305739836ae536b42468263091caacff77e609be: Status 404 returned error can't find the container with id 07060e349504758926afb659305739836ae536b42468263091caacff77e609be Jun 07 19:35:24.398404 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:24.398320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" event={"ID":"7ceef642-b122-42d4-8a5b-6661b34b8715","Type":"ContainerStarted","Data":"07060e349504758926afb659305739836ae536b42468263091caacff77e609be"} Jun 07 19:35:26.409841 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:26.409746 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" event={"ID":"7ceef642-b122-42d4-8a5b-6661b34b8715","Type":"ContainerStarted","Data":"5767be1bea3276bf0621030208eaf304d0fa75e18c40e15b7c599c996c72e9d4"} Jun 07 19:35:26.423356 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:26.423302 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" podStartSLOduration=1.652437266 podStartE2EDuration="3.42328456s" totalImagesPullingTime="1.770847294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:35:26.422585318 +0000 UTC m=+354.097610220" watchObservedRunningTime="2026-06-07 19:35:26.42328456 +0000 UTC m=+354.098309459" Jun 07 19:35:34.117560 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:34.117518 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" Jun 07 19:35:34.118049 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:34.117622 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" Jun 07 19:35:34.139461 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:34.139435 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" Jun 07 19:35:34.469585 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:34.469515 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dt4d2" Jun 07 19:35:38.839903 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:38.839862 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4"] Jun 07 19:35:38.851930 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:38.851896 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4"] Jun 07 19:35:38.852098 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:38.851992 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:38.854581 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:38.854558 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6dzjf\"" Jun 07 19:35:38.955077 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:38.955039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:38.955077 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:38.955078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:38.955293 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:38.955158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhknq\" (UniqueName: \"kubernetes.io/projected/753b3b44-a366-4024-92e1-9bb29605054f-kube-api-access-dhknq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:39.056402 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.056368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:39.056402 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.056400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:39.056618 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.056486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhknq\" (UniqueName: \"kubernetes.io/projected/753b3b44-a366-4024-92e1-9bb29605054f-kube-api-access-dhknq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:39.056829 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.056798 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:39.056865 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.056819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:39.064852 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.064833 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhknq\" (UniqueName: \"kubernetes.io/projected/753b3b44-a366-4024-92e1-9bb29605054f-kube-api-access-dhknq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:39.161272 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.161194 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:39.233312 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.233279 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh"] Jun 07 19:35:39.238240 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.238216 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:39.244484 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.244455 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh"] Jun 07 19:35:39.296185 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.296157 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4"] Jun 07 19:35:39.297753 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:35:39.297725 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753b3b44_a366_4024_92e1_9bb29605054f.slice/crio-2fd2b51fcd873e2c5f0f24211c85ef4a0eb485a0f86f353f8dfd94d85fa96bfc WatchSource:0}: Error finding container 2fd2b51fcd873e2c5f0f24211c85ef4a0eb485a0f86f353f8dfd94d85fa96bfc: Status 404 returned error can't find the container with id 2fd2b51fcd873e2c5f0f24211c85ef4a0eb485a0f86f353f8dfd94d85fa96bfc Jun 07 19:35:39.359182 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.359157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:39.359269 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.359208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:39.359269 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.359238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmjj4\" (UniqueName: \"kubernetes.io/projected/f6daf854-db69-4058-8c39-47ce600cef84-kube-api-access-tmjj4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:39.460512 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.460444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:39.460512 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.460492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:39.460668 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.460521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmjj4\" (UniqueName: \"kubernetes.io/projected/f6daf854-db69-4058-8c39-47ce600cef84-kube-api-access-tmjj4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:39.460755 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.460734 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:39.460831 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.460814 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:39.468552 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.468523 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmjj4\" (UniqueName: \"kubernetes.io/projected/f6daf854-db69-4058-8c39-47ce600cef84-kube-api-access-tmjj4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:39.472602 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.472572 2562 generic.go:356] "Generic (PLEG): container finished" podID="753b3b44-a366-4024-92e1-9bb29605054f" containerID="a06585a92472b0cfe1b508d4b5f1f6266433ca147a0de6102f5ebf22a1323548" exitCode=0 Jun 07 19:35:39.472711 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.472653 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" event={"ID":"753b3b44-a366-4024-92e1-9bb29605054f","Type":"ContainerDied","Data":"a06585a92472b0cfe1b508d4b5f1f6266433ca147a0de6102f5ebf22a1323548"} Jun 07 19:35:39.472711 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.472698 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" event={"ID":"753b3b44-a366-4024-92e1-9bb29605054f","Type":"ContainerStarted","Data":"2fd2b51fcd873e2c5f0f24211c85ef4a0eb485a0f86f353f8dfd94d85fa96bfc"} Jun 07 19:35:39.549761 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.549726 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:39.632697 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.632644 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw"] Jun 07 19:35:39.637754 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.637731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:39.645377 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.645336 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw"] Jun 07 19:35:39.687700 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.687673 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh"] Jun 07 19:35:39.689190 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:35:39.689165 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6daf854_db69_4058_8c39_47ce600cef84.slice/crio-4fe5d50c95dcbedf66169e2fb5705883336236057b255891128e35ab0506540a WatchSource:0}: Error finding container 4fe5d50c95dcbedf66169e2fb5705883336236057b255891128e35ab0506540a: Status 404 returned error can't find the container with id 4fe5d50c95dcbedf66169e2fb5705883336236057b255891128e35ab0506540a Jun 07 19:35:39.762910 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.762886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:39.763018 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.762926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:39.763018 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.762990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbg42\" (UniqueName: \"kubernetes.io/projected/f60cc854-d431-4d19-b6e0-86fcaa2737ff-kube-api-access-nbg42\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:39.863835 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.863805 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:39.864203 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.863848 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:39.864203 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.864026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbg42\" (UniqueName: \"kubernetes.io/projected/f60cc854-d431-4d19-b6e0-86fcaa2737ff-kube-api-access-nbg42\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:39.864203 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.864176 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:39.864372 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.864205 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:39.872730 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.872707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbg42\" (UniqueName: \"kubernetes.io/projected/f60cc854-d431-4d19-b6e0-86fcaa2737ff-kube-api-access-nbg42\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:39.951775 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:39.951747 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:40.033653 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.033624 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68"] Jun 07 19:35:40.038082 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.038060 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:40.049198 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.049157 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68"] Jun 07 19:35:40.104437 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.103318 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw"] Jun 07 19:35:40.110049 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:35:40.110020 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60cc854_d431_4d19_b6e0_86fcaa2737ff.slice/crio-79f32164d2176a54de3713c76134f0a2db4fc246c2a9cc8e03dfb067d0d47da5 WatchSource:0}: Error finding container 79f32164d2176a54de3713c76134f0a2db4fc246c2a9cc8e03dfb067d0d47da5: Status 404 returned error can't find the container with id 79f32164d2176a54de3713c76134f0a2db4fc246c2a9cc8e03dfb067d0d47da5 Jun 07 19:35:40.166544 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.166520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:40.166700 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.166659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:40.166765 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.166705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq484\" (UniqueName: \"kubernetes.io/projected/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-kube-api-access-wq484\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:40.267182 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.267113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:40.267182 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.267152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq484\" (UniqueName: \"kubernetes.io/projected/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-kube-api-access-wq484\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:40.267182 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.267179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:40.267555 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.267532 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:40.267610 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.267543 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:40.274373 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.274352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq484\" (UniqueName: \"kubernetes.io/projected/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-kube-api-access-wq484\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:40.354648 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.354611 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:40.480818 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.480786 2562 generic.go:356] "Generic (PLEG): container finished" podID="f60cc854-d431-4d19-b6e0-86fcaa2737ff" containerID="c54cc6be62e40da031b95abc95fa58e6661c9de8dddb0ce4ffdf6646eaef0715" exitCode=0 Jun 07 19:35:40.480988 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.480880 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" event={"ID":"f60cc854-d431-4d19-b6e0-86fcaa2737ff","Type":"ContainerDied","Data":"c54cc6be62e40da031b95abc95fa58e6661c9de8dddb0ce4ffdf6646eaef0715"} Jun 07 19:35:40.480988 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.480927 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" event={"ID":"f60cc854-d431-4d19-b6e0-86fcaa2737ff","Type":"ContainerStarted","Data":"79f32164d2176a54de3713c76134f0a2db4fc246c2a9cc8e03dfb067d0d47da5"} Jun 07 19:35:40.489159 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.486924 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68"] Jun 07 19:35:40.490481 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.490454 2562 generic.go:356] "Generic (PLEG): container finished" podID="753b3b44-a366-4024-92e1-9bb29605054f" containerID="2dd97a8b8275317518dcdf19504d7f0e784a440bf83c4f61fdf8a05eff06cc28" exitCode=0 Jun 07 19:35:40.490586 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.490526 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" event={"ID":"753b3b44-a366-4024-92e1-9bb29605054f","Type":"ContainerDied","Data":"2dd97a8b8275317518dcdf19504d7f0e784a440bf83c4f61fdf8a05eff06cc28"} Jun 07 19:35:40.492339 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.492312 2562 generic.go:356] "Generic (PLEG): container finished" podID="f6daf854-db69-4058-8c39-47ce600cef84" containerID="0ad541dfd5c58190fa35a7ddb2f5f89925cdc1705a96cee471307db99b05a27c" exitCode=0 Jun 07 19:35:40.492339 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.492332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" event={"ID":"f6daf854-db69-4058-8c39-47ce600cef84","Type":"ContainerDied","Data":"0ad541dfd5c58190fa35a7ddb2f5f89925cdc1705a96cee471307db99b05a27c"} Jun 07 19:35:40.492531 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:40.492368 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" event={"ID":"f6daf854-db69-4058-8c39-47ce600cef84","Type":"ContainerStarted","Data":"4fe5d50c95dcbedf66169e2fb5705883336236057b255891128e35ab0506540a"} Jun 07 19:35:41.499660 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:41.499630 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" event={"ID":"f60cc854-d431-4d19-b6e0-86fcaa2737ff","Type":"ContainerStarted","Data":"0f08c2d72aa7b087d7466d815fd389dd9cd74eda1642e846131a43b409721252"} Jun 07 19:35:41.501832 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:41.501809 2562 generic.go:356] "Generic (PLEG): container finished" podID="753b3b44-a366-4024-92e1-9bb29605054f" containerID="502c978907b031f9e8bf881181ab9d286dd5baa5eff9d83d67157b026e348668" exitCode=0 Jun 07 19:35:41.501957 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:41.501893 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" event={"ID":"753b3b44-a366-4024-92e1-9bb29605054f","Type":"ContainerDied","Data":"502c978907b031f9e8bf881181ab9d286dd5baa5eff9d83d67157b026e348668"} Jun 07 19:35:41.504019 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:41.503995 2562 generic.go:356] "Generic (PLEG): container finished" podID="f6daf854-db69-4058-8c39-47ce600cef84" containerID="8e05fe6b79d6d76f096747a3104ea4ed819be4add74646b6263cae4e8b879741" exitCode=0 Jun 07 19:35:41.504127 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:41.504094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" event={"ID":"f6daf854-db69-4058-8c39-47ce600cef84","Type":"ContainerDied","Data":"8e05fe6b79d6d76f096747a3104ea4ed819be4add74646b6263cae4e8b879741"} Jun 07 19:35:41.505570 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:41.505546 2562 generic.go:356] "Generic (PLEG): container finished" podID="a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" containerID="6452e197aedc76c70fade29825a95589d57e75ff14e191474b76e765d3da73b0" exitCode=0 Jun 07 19:35:41.505669 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:41.505572 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" event={"ID":"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6","Type":"ContainerDied","Data":"6452e197aedc76c70fade29825a95589d57e75ff14e191474b76e765d3da73b0"} Jun 07 19:35:41.505669 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:41.505609 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" event={"ID":"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6","Type":"ContainerStarted","Data":"8ee70f4c3b08ca326d80afc4b7698b72e99e63614e9b1d4191dbf6c66d193299"} Jun 07 19:35:42.512222 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.512123 2562 generic.go:356] "Generic (PLEG): container finished" podID="a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" containerID="edb83b9d0d12a145ca6e00f5614b880a80a3e9352c0b8ea31877c46e697efec5" exitCode=0 Jun 07 19:35:42.512656 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.512222 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" event={"ID":"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6","Type":"ContainerDied","Data":"edb83b9d0d12a145ca6e00f5614b880a80a3e9352c0b8ea31877c46e697efec5"} Jun 07 19:35:42.514002 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.513979 2562 generic.go:356] "Generic (PLEG): container finished" podID="f60cc854-d431-4d19-b6e0-86fcaa2737ff" containerID="0f08c2d72aa7b087d7466d815fd389dd9cd74eda1642e846131a43b409721252" exitCode=0 Jun 07 19:35:42.514109 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.514062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" event={"ID":"f60cc854-d431-4d19-b6e0-86fcaa2737ff","Type":"ContainerDied","Data":"0f08c2d72aa7b087d7466d815fd389dd9cd74eda1642e846131a43b409721252"} Jun 07 19:35:42.516456 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.516436 2562 generic.go:356] "Generic (PLEG): container finished" podID="f6daf854-db69-4058-8c39-47ce600cef84" containerID="ce4c06960649cde40f156b8a544f18ad245c8c4dfd4dc0c90455413b16e85c03" exitCode=0 Jun 07 19:35:42.516566 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.516502 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" event={"ID":"f6daf854-db69-4058-8c39-47ce600cef84","Type":"ContainerDied","Data":"ce4c06960649cde40f156b8a544f18ad245c8c4dfd4dc0c90455413b16e85c03"} Jun 07 19:35:42.649564 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.649538 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:42.787167 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.787145 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-util\") pod \"753b3b44-a366-4024-92e1-9bb29605054f\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " Jun 07 19:35:42.787334 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.787217 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhknq\" (UniqueName: \"kubernetes.io/projected/753b3b44-a366-4024-92e1-9bb29605054f-kube-api-access-dhknq\") pod \"753b3b44-a366-4024-92e1-9bb29605054f\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " Jun 07 19:35:42.787334 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.787247 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-bundle\") pod \"753b3b44-a366-4024-92e1-9bb29605054f\" (UID: \"753b3b44-a366-4024-92e1-9bb29605054f\") " Jun 07 19:35:42.787795 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.787758 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-bundle" (OuterVolumeSpecName: "bundle") pod "753b3b44-a366-4024-92e1-9bb29605054f" (UID: "753b3b44-a366-4024-92e1-9bb29605054f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:35:42.789360 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.789335 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753b3b44-a366-4024-92e1-9bb29605054f-kube-api-access-dhknq" (OuterVolumeSpecName: "kube-api-access-dhknq") pod "753b3b44-a366-4024-92e1-9bb29605054f" (UID: "753b3b44-a366-4024-92e1-9bb29605054f"). InnerVolumeSpecName "kube-api-access-dhknq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:35:42.792096 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.792074 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-util" (OuterVolumeSpecName: "util") pod "753b3b44-a366-4024-92e1-9bb29605054f" (UID: "753b3b44-a366-4024-92e1-9bb29605054f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:35:42.888060 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.888025 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhknq\" (UniqueName: \"kubernetes.io/projected/753b3b44-a366-4024-92e1-9bb29605054f-kube-api-access-dhknq\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:42.888060 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.888054 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:42.888060 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:42.888064 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/753b3b44-a366-4024-92e1-9bb29605054f-util\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:43.523431 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.523376 2562 generic.go:356] "Generic (PLEG): container finished" podID="a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" containerID="7465853a0595b3487e411e44a37dfcbfdeadac4ee2452eb9dfc51cf1fb83041d" exitCode=0 Jun 07 19:35:43.523802 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.523462 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" event={"ID":"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6","Type":"ContainerDied","Data":"7465853a0595b3487e411e44a37dfcbfdeadac4ee2452eb9dfc51cf1fb83041d"} Jun 07 19:35:43.525446 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.525405 2562 generic.go:356] "Generic (PLEG): container finished" podID="f60cc854-d431-4d19-b6e0-86fcaa2737ff" containerID="fedff46e4798a5158784e8c2af1292f33f2ffe4f2f2da9a6e0b98c29aebc5162" exitCode=0 Jun 07 19:35:43.525527 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.525506 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" event={"ID":"f60cc854-d431-4d19-b6e0-86fcaa2737ff","Type":"ContainerDied","Data":"fedff46e4798a5158784e8c2af1292f33f2ffe4f2f2da9a6e0b98c29aebc5162"} Jun 07 19:35:43.527451 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.527430 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" Jun 07 19:35:43.527451 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.527439 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4" event={"ID":"753b3b44-a366-4024-92e1-9bb29605054f","Type":"ContainerDied","Data":"2fd2b51fcd873e2c5f0f24211c85ef4a0eb485a0f86f353f8dfd94d85fa96bfc"} Jun 07 19:35:43.527592 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.527469 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2fd2b51fcd873e2c5f0f24211c85ef4a0eb485a0f86f353f8dfd94d85fa96bfc" Jun 07 19:35:43.657173 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.657150 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:43.795331 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.795253 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmjj4\" (UniqueName: \"kubernetes.io/projected/f6daf854-db69-4058-8c39-47ce600cef84-kube-api-access-tmjj4\") pod \"f6daf854-db69-4058-8c39-47ce600cef84\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " Jun 07 19:35:43.795331 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.795324 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-bundle\") pod \"f6daf854-db69-4058-8c39-47ce600cef84\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " Jun 07 19:35:43.795554 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.795369 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-util\") pod \"f6daf854-db69-4058-8c39-47ce600cef84\" (UID: \"f6daf854-db69-4058-8c39-47ce600cef84\") " Jun 07 19:35:43.795908 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.795875 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-bundle" (OuterVolumeSpecName: "bundle") pod "f6daf854-db69-4058-8c39-47ce600cef84" (UID: "f6daf854-db69-4058-8c39-47ce600cef84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:35:43.797345 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.797318 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6daf854-db69-4058-8c39-47ce600cef84-kube-api-access-tmjj4" (OuterVolumeSpecName: "kube-api-access-tmjj4") pod "f6daf854-db69-4058-8c39-47ce600cef84" (UID: "f6daf854-db69-4058-8c39-47ce600cef84"). InnerVolumeSpecName "kube-api-access-tmjj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:35:43.800830 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.800806 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-util" (OuterVolumeSpecName: "util") pod "f6daf854-db69-4058-8c39-47ce600cef84" (UID: "f6daf854-db69-4058-8c39-47ce600cef84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:35:43.896789 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.896752 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-util\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:43.896789 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.896796 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmjj4\" (UniqueName: \"kubernetes.io/projected/f6daf854-db69-4058-8c39-47ce600cef84-kube-api-access-tmjj4\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:43.896989 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:43.896811 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6daf854-db69-4058-8c39-47ce600cef84-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:44.535093 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.535065 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" Jun 07 19:35:44.535639 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.535097 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh" event={"ID":"f6daf854-db69-4058-8c39-47ce600cef84","Type":"ContainerDied","Data":"4fe5d50c95dcbedf66169e2fb5705883336236057b255891128e35ab0506540a"} Jun 07 19:35:44.535639 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.535148 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fe5d50c95dcbedf66169e2fb5705883336236057b255891128e35ab0506540a" Jun 07 19:35:44.671229 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.671207 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:44.708004 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.707979 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:44.804732 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.804652 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq484\" (UniqueName: \"kubernetes.io/projected/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-kube-api-access-wq484\") pod \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " Jun 07 19:35:44.804732 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.804719 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-bundle\") pod \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " Jun 07 19:35:44.804932 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.804749 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-util\") pod \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\" (UID: \"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6\") " Jun 07 19:35:44.804932 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.804778 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbg42\" (UniqueName: \"kubernetes.io/projected/f60cc854-d431-4d19-b6e0-86fcaa2737ff-kube-api-access-nbg42\") pod \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " Jun 07 19:35:44.804932 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.804812 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-util\") pod \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " Jun 07 19:35:44.805086 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.804955 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-bundle\") pod \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\" (UID: \"f60cc854-d431-4d19-b6e0-86fcaa2737ff\") " Jun 07 19:35:44.805554 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.805526 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-bundle" (OuterVolumeSpecName: "bundle") pod "a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" (UID: "a00e7b05-e4c9-4c2c-8549-e5c23962c8d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:35:44.805683 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.805534 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-bundle" (OuterVolumeSpecName: "bundle") pod "f60cc854-d431-4d19-b6e0-86fcaa2737ff" (UID: "f60cc854-d431-4d19-b6e0-86fcaa2737ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:35:44.806916 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.806886 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f60cc854-d431-4d19-b6e0-86fcaa2737ff-kube-api-access-nbg42" (OuterVolumeSpecName: "kube-api-access-nbg42") pod "f60cc854-d431-4d19-b6e0-86fcaa2737ff" (UID: "f60cc854-d431-4d19-b6e0-86fcaa2737ff"). InnerVolumeSpecName "kube-api-access-nbg42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:35:44.807088 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.807070 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-kube-api-access-wq484" (OuterVolumeSpecName: "kube-api-access-wq484") pod "a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" (UID: "a00e7b05-e4c9-4c2c-8549-e5c23962c8d6"). InnerVolumeSpecName "kube-api-access-wq484". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:35:44.810900 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.810880 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-util" (OuterVolumeSpecName: "util") pod "f60cc854-d431-4d19-b6e0-86fcaa2737ff" (UID: "f60cc854-d431-4d19-b6e0-86fcaa2737ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:35:44.811011 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.810976 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-util" (OuterVolumeSpecName: "util") pod "a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" (UID: "a00e7b05-e4c9-4c2c-8549-e5c23962c8d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:35:44.905592 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.905546 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbg42\" (UniqueName: \"kubernetes.io/projected/f60cc854-d431-4d19-b6e0-86fcaa2737ff-kube-api-access-nbg42\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:44.905592 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.905588 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-util\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:44.905592 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.905599 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60cc854-d431-4d19-b6e0-86fcaa2737ff-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:44.905592 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.905608 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq484\" (UniqueName: \"kubernetes.io/projected/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-kube-api-access-wq484\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:44.905841 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.905617 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:44.905841 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:44.905625 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a00e7b05-e4c9-4c2c-8549-e5c23962c8d6-util\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:35:45.541751 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:45.541721 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" Jun 07 19:35:45.542157 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:45.541744 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw" event={"ID":"f60cc854-d431-4d19-b6e0-86fcaa2737ff","Type":"ContainerDied","Data":"79f32164d2176a54de3713c76134f0a2db4fc246c2a9cc8e03dfb067d0d47da5"} Jun 07 19:35:45.542157 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:45.541793 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79f32164d2176a54de3713c76134f0a2db4fc246c2a9cc8e03dfb067d0d47da5" Jun 07 19:35:45.543695 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:45.543668 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" event={"ID":"a00e7b05-e4c9-4c2c-8549-e5c23962c8d6","Type":"ContainerDied","Data":"8ee70f4c3b08ca326d80afc4b7698b72e99e63614e9b1d4191dbf6c66d193299"} Jun 07 19:35:45.543828 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:45.543706 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ee70f4c3b08ca326d80afc4b7698b72e99e63614e9b1d4191dbf6c66d193299" Jun 07 19:35:45.543828 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:45.543711 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68" Jun 07 19:35:51.908472 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:51.908403 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:35:54.536705 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.536673 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf"] Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537010 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6daf854-db69-4058-8c39-47ce600cef84" containerName="pull" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537023 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6daf854-db69-4058-8c39-47ce600cef84" containerName="pull" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537031 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60cc854-d431-4d19-b6e0-86fcaa2737ff" containerName="pull" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537038 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60cc854-d431-4d19-b6e0-86fcaa2737ff" containerName="pull" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537046 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6daf854-db69-4058-8c39-47ce600cef84" containerName="util" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537053 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6daf854-db69-4058-8c39-47ce600cef84" containerName="util" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537060 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" containerName="pull" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537065 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" containerName="pull" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537072 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753b3b44-a366-4024-92e1-9bb29605054f" containerName="pull" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537076 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="753b3b44-a366-4024-92e1-9bb29605054f" containerName="pull" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537083 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753b3b44-a366-4024-92e1-9bb29605054f" containerName="util" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537089 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="753b3b44-a366-4024-92e1-9bb29605054f" containerName="util" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537094 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60cc854-d431-4d19-b6e0-86fcaa2737ff" containerName="extract" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537099 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60cc854-d431-4d19-b6e0-86fcaa2737ff" containerName="extract" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537106 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" containerName="util" Jun 07 19:35:54.537103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537111 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" containerName="util" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537118 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" containerName="extract" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537137 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" containerName="extract" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537148 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6daf854-db69-4058-8c39-47ce600cef84" containerName="extract" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537153 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6daf854-db69-4058-8c39-47ce600cef84" containerName="extract" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537162 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753b3b44-a366-4024-92e1-9bb29605054f" containerName="extract" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537167 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="753b3b44-a366-4024-92e1-9bb29605054f" containerName="extract" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537174 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60cc854-d431-4d19-b6e0-86fcaa2737ff" containerName="util" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537179 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60cc854-d431-4d19-b6e0-86fcaa2737ff" containerName="util" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537231 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6daf854-db69-4058-8c39-47ce600cef84" containerName="extract" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537249 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="753b3b44-a366-4024-92e1-9bb29605054f" containerName="extract" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537256 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a00e7b05-e4c9-4c2c-8549-e5c23962c8d6" containerName="extract" Jun 07 19:35:54.537727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.537261 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f60cc854-d431-4d19-b6e0-86fcaa2737ff" containerName="extract" Jun 07 19:35:54.540329 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.540314 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf" Jun 07 19:35:54.542969 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.542939 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 07 19:35:54.543078 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.543017 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-69cqq\"" Jun 07 19:35:54.555090 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.555065 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf"] Jun 07 19:35:54.583028 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.582999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25gp6\" (UniqueName: \"kubernetes.io/projected/6cab621c-f31b-4075-be4b-f091eaad46e9-kube-api-access-25gp6\") pod \"dns-operator-controller-manager-864dd78c4c-tsdkf\" (UID: \"6cab621c-f31b-4075-be4b-f091eaad46e9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf" Jun 07 19:35:54.683909 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.683878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25gp6\" (UniqueName: \"kubernetes.io/projected/6cab621c-f31b-4075-be4b-f091eaad46e9-kube-api-access-25gp6\") pod \"dns-operator-controller-manager-864dd78c4c-tsdkf\" (UID: \"6cab621c-f31b-4075-be4b-f091eaad46e9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf" Jun 07 19:35:54.697391 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.697366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25gp6\" (UniqueName: \"kubernetes.io/projected/6cab621c-f31b-4075-be4b-f091eaad46e9-kube-api-access-25gp6\") pod \"dns-operator-controller-manager-864dd78c4c-tsdkf\" (UID: \"6cab621c-f31b-4075-be4b-f091eaad46e9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf" Jun 07 19:35:54.850402 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.850316 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf" Jun 07 19:35:54.985467 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:54.985430 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf"] Jun 07 19:35:54.986863 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:35:54.986836 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cab621c_f31b_4075_be4b_f091eaad46e9.slice/crio-7210026c055377d759ebe6225454e66e638b9682b28e62e649c5cab9afb587a1 WatchSource:0}: Error finding container 7210026c055377d759ebe6225454e66e638b9682b28e62e649c5cab9afb587a1: Status 404 returned error can't find the container with id 7210026c055377d759ebe6225454e66e638b9682b28e62e649c5cab9afb587a1 Jun 07 19:35:55.602983 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:55.602948 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf" event={"ID":"6cab621c-f31b-4075-be4b-f091eaad46e9","Type":"ContainerStarted","Data":"7210026c055377d759ebe6225454e66e638b9682b28e62e649c5cab9afb587a1"} Jun 07 19:35:56.100607 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:56.100510 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:35:57.617271 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:57.617230 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf" event={"ID":"6cab621c-f31b-4075-be4b-f091eaad46e9","Type":"ContainerStarted","Data":"d077d7253e156dcd956ce25d1904745882f28ecd78c261612fb1dccd859265e7"} Jun 07 19:35:57.617640 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:57.617313 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf" Jun 07 19:35:57.633667 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:57.633598 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf" podStartSLOduration=1.854717585 podStartE2EDuration="3.633579355s" totalImagesPullingTime="1.77886177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:35:57.632488616 +0000 UTC m=+385.307513508" watchObservedRunningTime="2026-06-07 19:35:57.633579355 +0000 UTC m=+385.308604254" Jun 07 19:35:57.931319 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:57.931242 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46"] Jun 07 19:35:57.935806 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:57.935782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" Jun 07 19:35:57.938284 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:57.938265 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ptdtv\"" Jun 07 19:35:57.945569 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:57.945547 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46"] Jun 07 19:35:58.004369 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:58.004336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x85q7\" (UniqueName: \"kubernetes.io/projected/0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb-kube-api-access-x85q7\") pod \"limitador-operator-controller-manager-859d7b78bd-zvt46\" (UID: \"0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" Jun 07 19:35:58.105727 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:58.105694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x85q7\" (UniqueName: \"kubernetes.io/projected/0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb-kube-api-access-x85q7\") pod \"limitador-operator-controller-manager-859d7b78bd-zvt46\" (UID: \"0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" Jun 07 19:35:58.117566 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:58.117542 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x85q7\" (UniqueName: \"kubernetes.io/projected/0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb-kube-api-access-x85q7\") pod \"limitador-operator-controller-manager-859d7b78bd-zvt46\" (UID: \"0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" Jun 07 19:35:58.247322 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:58.247220 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" Jun 07 19:35:58.377550 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:58.377527 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46"] Jun 07 19:35:58.378764 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:35:58.378731 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0ecf17_d0e6_4a56_9f98_7daaa0960bbb.slice/crio-6e640c82feaf08a56457d372037c676d538d1df2cfbb254f87509ee4a95db793 WatchSource:0}: Error finding container 6e640c82feaf08a56457d372037c676d538d1df2cfbb254f87509ee4a95db793: Status 404 returned error can't find the container with id 6e640c82feaf08a56457d372037c676d538d1df2cfbb254f87509ee4a95db793 Jun 07 19:35:58.493579 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:58.493545 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:35:58.623534 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:58.623498 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" event={"ID":"0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb","Type":"ContainerStarted","Data":"6e640c82feaf08a56457d372037c676d538d1df2cfbb254f87509ee4a95db793"} Jun 07 19:35:58.734672 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:58.734639 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:35:59.094353 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:35:59.094318 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:00.635391 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:00.635356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" event={"ID":"0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb","Type":"ContainerStarted","Data":"91bd2b4dd6cbf7c0557360fd35716f4a67e146932fa195d13b144da2ce3019fe"} Jun 07 19:36:00.635791 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:00.635475 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" Jun 07 19:36:00.654283 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:00.654233 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" podStartSLOduration=1.9680905850000001 podStartE2EDuration="3.654219499s" totalImagesPullingTime="1.686128914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:36:00.652077895 +0000 UTC m=+388.327102794" watchObservedRunningTime="2026-06-07 19:36:00.654219499 +0000 UTC m=+388.329244396" Jun 07 19:36:02.498144 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:02.498109 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:03.543586 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:03.543546 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:05.549670 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:05.549633 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:07.345494 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:07.345453 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:08.626680 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:08.626646 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsdkf" Jun 07 19:36:08.717225 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:08.717188 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:08.814522 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:08.814482 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:11.642710 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:11.642681 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" Jun 07 19:36:12.505237 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:12.505203 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:12.610834 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:12.610799 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:14.467331 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:14.467292 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:14.836190 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:14.836150 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:16.699872 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:16.699825 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:16.800171 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:16.800125 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:17.099716 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:17.099680 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:17.212527 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:17.212493 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:20.882675 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:20.882625 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:20.981394 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:20.981363 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:23.735374 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:23.735339 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4"] Jun 07 19:36:23.738943 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:23.738922 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:23.741553 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:23.741531 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pw6q4\"" Jun 07 19:36:23.757284 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:23.757256 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4"] Jun 07 19:36:23.816946 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:23.816911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwfkq\" (UniqueName: \"kubernetes.io/projected/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-kube-api-access-xwfkq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bqph4\" (UID: \"a52dd9fb-8d17-4b9c-aac7-9653e40cac3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:23.817109 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:23.816952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bqph4\" (UID: \"a52dd9fb-8d17-4b9c-aac7-9653e40cac3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:23.918256 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:23.918221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwfkq\" (UniqueName: \"kubernetes.io/projected/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-kube-api-access-xwfkq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bqph4\" (UID: \"a52dd9fb-8d17-4b9c-aac7-9653e40cac3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:23.918481 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:23.918260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bqph4\" (UID: \"a52dd9fb-8d17-4b9c-aac7-9653e40cac3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:23.918647 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:23.918628 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bqph4\" (UID: \"a52dd9fb-8d17-4b9c-aac7-9653e40cac3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:23.926971 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:23.926946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwfkq\" (UniqueName: \"kubernetes.io/projected/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-kube-api-access-xwfkq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bqph4\" (UID: \"a52dd9fb-8d17-4b9c-aac7-9653e40cac3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:24.048847 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.048814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:24.181970 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.181940 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4"] Jun 07 19:36:24.183375 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:36:24.183343 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda52dd9fb_8d17_4b9c_aac7_9653e40cac3d.slice/crio-055d95e9f5137c7ad049dff00632c27f2e60e1e989833426136ef7bc1c7bdb7d WatchSource:0}: Error finding container 055d95e9f5137c7ad049dff00632c27f2e60e1e989833426136ef7bc1c7bdb7d: Status 404 returned error can't find the container with id 055d95e9f5137c7ad049dff00632c27f2e60e1e989833426136ef7bc1c7bdb7d Jun 07 19:36:24.567881 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.567845 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4"] Jun 07 19:36:24.576121 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.576091 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4"] Jun 07 19:36:24.595103 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.594931 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh"] Jun 07 19:36:24.599468 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.599448 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:24.611558 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.611534 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh"] Jun 07 19:36:24.616986 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.616965 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46"] Jun 07 19:36:24.617147 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.617129 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" podUID="0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb" containerName="manager" containerID="cri-o://91bd2b4dd6cbf7c0557360fd35716f4a67e146932fa195d13b144da2ce3019fe" gracePeriod=2 Jun 07 19:36:24.628023 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:36:24.627993 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zvt46\" is forbidden: User \"system:node:ip-10-0-128-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-213.ec2.internal' and this object" podUID="0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" Jun 07 19:36:24.634061 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.634036 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46"] Jun 07 19:36:24.724257 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.724222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fd6z\" (UniqueName: \"kubernetes.io/projected/20680c56-a79c-432b-9104-d57ad11cb244-kube-api-access-5fd6z\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7grvh\" (UID: \"20680c56-a79c-432b-9104-d57ad11cb244\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:24.724445 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.724371 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20680c56-a79c-432b-9104-d57ad11cb244-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7grvh\" (UID: \"20680c56-a79c-432b-9104-d57ad11cb244\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:24.769026 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.768988 2562 generic.go:356] "Generic (PLEG): container finished" podID="0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb" containerID="91bd2b4dd6cbf7c0557360fd35716f4a67e146932fa195d13b144da2ce3019fe" exitCode=0 Jun 07 19:36:24.825134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.825050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fd6z\" (UniqueName: \"kubernetes.io/projected/20680c56-a79c-432b-9104-d57ad11cb244-kube-api-access-5fd6z\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7grvh\" (UID: \"20680c56-a79c-432b-9104-d57ad11cb244\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:24.825276 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.825203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20680c56-a79c-432b-9104-d57ad11cb244-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7grvh\" (UID: \"20680c56-a79c-432b-9104-d57ad11cb244\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:24.825644 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.825621 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20680c56-a79c-432b-9104-d57ad11cb244-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7grvh\" (UID: \"20680c56-a79c-432b-9104-d57ad11cb244\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:24.836244 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.836223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fd6z\" (UniqueName: \"kubernetes.io/projected/20680c56-a79c-432b-9104-d57ad11cb244-kube-api-access-5fd6z\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7grvh\" (UID: \"20680c56-a79c-432b-9104-d57ad11cb244\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:24.865216 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.865195 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" Jun 07 19:36:24.911658 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.911625 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:24.925810 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.925783 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x85q7\" (UniqueName: \"kubernetes.io/projected/0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb-kube-api-access-x85q7\") pod \"0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb\" (UID: \"0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb\") " Jun 07 19:36:24.928111 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:24.928081 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb-kube-api-access-x85q7" (OuterVolumeSpecName: "kube-api-access-x85q7") pod "0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb" (UID: "0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb"). InnerVolumeSpecName "kube-api-access-x85q7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:36:25.027175 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:25.027139 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x85q7\" (UniqueName: \"kubernetes.io/projected/0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb-kube-api-access-x85q7\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:36:25.069993 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:25.069793 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh"] Jun 07 19:36:25.780259 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:25.780234 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zvt46" Jun 07 19:36:25.780771 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:25.780236 2562 scope.go:117] "RemoveContainer" containerID="91bd2b4dd6cbf7c0557360fd35716f4a67e146932fa195d13b144da2ce3019fe" Jun 07 19:36:25.782428 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:25.782377 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" event={"ID":"20680c56-a79c-432b-9104-d57ad11cb244","Type":"ContainerStarted","Data":"fc4044b2bd55de1952f52a5f929bd2c69d0c97f590bae02a5a0ceda2239fba44"} Jun 07 19:36:26.762668 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:26.762632 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb" path="/var/lib/kubelet/pods/0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb/volumes" Jun 07 19:36:27.495327 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:27.495281 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:27.592147 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:27.592111 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:28.803114 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:28.803075 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" event={"ID":"20680c56-a79c-432b-9104-d57ad11cb244","Type":"ContainerStarted","Data":"29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e"} Jun 07 19:36:28.803552 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:28.803255 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:28.804751 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:28.804727 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" podUID="a52dd9fb-8d17-4b9c-aac7-9653e40cac3d" containerName="manager" containerID="cri-o://a44b3adad048e53783dded12663b9f11f8c0daa3e610ffd5ef3e90137f7fe053" gracePeriod=2 Jun 07 19:36:28.824301 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:28.824258 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" podStartSLOduration=1.919591829 podStartE2EDuration="4.824244529s" totalImagesPullingTime="2.9046527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:36:28.821604931 +0000 UTC m=+416.496629831" watchObservedRunningTime="2026-06-07 19:36:28.824244529 +0000 UTC m=+416.499269426" Jun 07 19:36:29.054688 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.054634 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:29.056764 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:36:29.056737 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-bqph4\" is forbidden: User \"system:node:ip-10-0-128-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-213.ec2.internal' and this object" podUID="a52dd9fb-8d17-4b9c-aac7-9653e40cac3d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:29.165392 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.165362 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-extensions-socket-volume\") pod \"a52dd9fb-8d17-4b9c-aac7-9653e40cac3d\" (UID: \"a52dd9fb-8d17-4b9c-aac7-9653e40cac3d\") " Jun 07 19:36:29.165590 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.165462 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwfkq\" (UniqueName: \"kubernetes.io/projected/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-kube-api-access-xwfkq\") pod \"a52dd9fb-8d17-4b9c-aac7-9653e40cac3d\" (UID: \"a52dd9fb-8d17-4b9c-aac7-9653e40cac3d\") " Jun 07 19:36:29.165668 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.165643 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a52dd9fb-8d17-4b9c-aac7-9653e40cac3d" (UID: "a52dd9fb-8d17-4b9c-aac7-9653e40cac3d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:36:29.167534 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.167509 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-kube-api-access-xwfkq" (OuterVolumeSpecName: "kube-api-access-xwfkq") pod "a52dd9fb-8d17-4b9c-aac7-9653e40cac3d" (UID: "a52dd9fb-8d17-4b9c-aac7-9653e40cac3d"). InnerVolumeSpecName "kube-api-access-xwfkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:36:29.266999 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.266968 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-extensions-socket-volume\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:36:29.266999 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.266995 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwfkq\" (UniqueName: \"kubernetes.io/projected/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d-kube-api-access-xwfkq\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:36:29.812051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.812012 2562 generic.go:356] "Generic (PLEG): container finished" podID="a52dd9fb-8d17-4b9c-aac7-9653e40cac3d" containerID="a44b3adad048e53783dded12663b9f11f8c0daa3e610ffd5ef3e90137f7fe053" exitCode=2 Jun 07 19:36:29.812051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.812054 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:29.812555 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.812106 2562 scope.go:117] "RemoveContainer" containerID="a44b3adad048e53783dded12663b9f11f8c0daa3e610ffd5ef3e90137f7fe053" Jun 07 19:36:29.814394 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:36:29.814362 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-bqph4\" is forbidden: User \"system:node:ip-10-0-128-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-213.ec2.internal' and this object" podUID="a52dd9fb-8d17-4b9c-aac7-9653e40cac3d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:29.821134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.821116 2562 scope.go:117] "RemoveContainer" containerID="a44b3adad048e53783dded12663b9f11f8c0daa3e610ffd5ef3e90137f7fe053" Jun 07 19:36:29.821433 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:36:29.821395 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a44b3adad048e53783dded12663b9f11f8c0daa3e610ffd5ef3e90137f7fe053\": container with ID starting with a44b3adad048e53783dded12663b9f11f8c0daa3e610ffd5ef3e90137f7fe053 not found: ID does not exist" containerID="a44b3adad048e53783dded12663b9f11f8c0daa3e610ffd5ef3e90137f7fe053" Jun 07 19:36:29.821502 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:29.821437 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44b3adad048e53783dded12663b9f11f8c0daa3e610ffd5ef3e90137f7fe053"} err="failed to get container status \"a44b3adad048e53783dded12663b9f11f8c0daa3e610ffd5ef3e90137f7fe053\": rpc error: code = NotFound desc = could not find container \"a44b3adad048e53783dded12663b9f11f8c0daa3e610ffd5ef3e90137f7fe053\": container with ID starting with a44b3adad048e53783dded12663b9f11f8c0daa3e610ffd5ef3e90137f7fe053 not found: ID does not exist" Jun 07 19:36:29.822087 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:36:29.822065 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-bqph4\" is forbidden: User \"system:node:ip-10-0-128-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-213.ec2.internal' and this object" podUID="a52dd9fb-8d17-4b9c-aac7-9653e40cac3d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bqph4" Jun 07 19:36:30.300976 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:30.300939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:30.401835 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:30.401795 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:30.760718 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:30.760639 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a52dd9fb-8d17-4b9c-aac7-9653e40cac3d" path="/var/lib/kubelet/pods/a52dd9fb-8d17-4b9c-aac7-9653e40cac3d/volumes" Jun 07 19:36:34.779093 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:34.779062 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:34.834054 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:34.834020 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:35.105772 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:35.105686 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:35.206054 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:35.206018 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:35.260731 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:35.260699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:38.643726 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:38.643682 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:38.747651 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:38.747608 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:39.815384 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:39.815348 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:40.046899 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.046866 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth"] Jun 07 19:36:40.047273 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.047257 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb" containerName="manager" Jun 07 19:36:40.047357 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.047276 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb" containerName="manager" Jun 07 19:36:40.047357 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.047298 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a52dd9fb-8d17-4b9c-aac7-9653e40cac3d" containerName="manager" Jun 07 19:36:40.047357 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.047307 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a52dd9fb-8d17-4b9c-aac7-9653e40cac3d" containerName="manager" Jun 07 19:36:40.047544 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.047427 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a52dd9fb-8d17-4b9c-aac7-9653e40cac3d" containerName="manager" Jun 07 19:36:40.047544 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.047443 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e0ecf17-d0e6-4a56-9f98-7daaa0960bbb" containerName="manager" Jun 07 19:36:40.052203 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.052176 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" Jun 07 19:36:40.061634 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.061607 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth"] Jun 07 19:36:40.170119 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.170089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c9351d2-5053-487c-bb4f-c3e6fd021687-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tsjth\" (UID: \"5c9351d2-5053-487c-bb4f-c3e6fd021687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" Jun 07 19:36:40.170293 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.170157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwtbk\" (UniqueName: \"kubernetes.io/projected/5c9351d2-5053-487c-bb4f-c3e6fd021687-kube-api-access-xwtbk\") pod \"kuadrant-operator-controller-manager-86878c769f-tsjth\" (UID: \"5c9351d2-5053-487c-bb4f-c3e6fd021687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" Jun 07 19:36:40.271226 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.271186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c9351d2-5053-487c-bb4f-c3e6fd021687-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tsjth\" (UID: \"5c9351d2-5053-487c-bb4f-c3e6fd021687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" Jun 07 19:36:40.271390 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.271273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwtbk\" (UniqueName: \"kubernetes.io/projected/5c9351d2-5053-487c-bb4f-c3e6fd021687-kube-api-access-xwtbk\") pod \"kuadrant-operator-controller-manager-86878c769f-tsjth\" (UID: \"5c9351d2-5053-487c-bb4f-c3e6fd021687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" Jun 07 19:36:40.271609 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.271589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c9351d2-5053-487c-bb4f-c3e6fd021687-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tsjth\" (UID: \"5c9351d2-5053-487c-bb4f-c3e6fd021687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" Jun 07 19:36:40.278928 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.278898 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwtbk\" (UniqueName: \"kubernetes.io/projected/5c9351d2-5053-487c-bb4f-c3e6fd021687-kube-api-access-xwtbk\") pod \"kuadrant-operator-controller-manager-86878c769f-tsjth\" (UID: \"5c9351d2-5053-487c-bb4f-c3e6fd021687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" Jun 07 19:36:40.363339 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.363309 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" Jun 07 19:36:40.496890 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.496866 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth"] Jun 07 19:36:40.499301 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:36:40.499270 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9351d2_5053_487c_bb4f_c3e6fd021687.slice/crio-f0ee7e1c989d3a8075b2c504443e0ba059b9b88ee38ee987edaf99e41867509d WatchSource:0}: Error finding container f0ee7e1c989d3a8075b2c504443e0ba059b9b88ee38ee987edaf99e41867509d: Status 404 returned error can't find the container with id f0ee7e1c989d3a8075b2c504443e0ba059b9b88ee38ee987edaf99e41867509d Jun 07 19:36:40.873282 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.873241 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" event={"ID":"5c9351d2-5053-487c-bb4f-c3e6fd021687","Type":"ContainerStarted","Data":"241ddf91c0ab82cbf9d6eaa56fe619cc7fecd2d2ddac3ea5798041be82050472"} Jun 07 19:36:40.873673 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.873303 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" event={"ID":"5c9351d2-5053-487c-bb4f-c3e6fd021687","Type":"ContainerStarted","Data":"f0ee7e1c989d3a8075b2c504443e0ba059b9b88ee38ee987edaf99e41867509d"} Jun 07 19:36:40.873673 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.873355 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" Jun 07 19:36:40.893949 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:40.893884 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" podStartSLOduration=0.893866706 podStartE2EDuration="893.866706ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:36:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:36:40.890832469 +0000 UTC m=+428.565857367" watchObservedRunningTime="2026-06-07 19:36:40.893866706 +0000 UTC m=+428.568891604" Jun 07 19:36:45.280907 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:45.280856 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:45.381478 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:45.381442 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:48.677441 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:48.677335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:48.775047 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:48.775008 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:51.880881 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:51.880852 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsjth" Jun 07 19:36:51.929273 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:51.929242 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh"] Jun 07 19:36:51.929517 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:51.929488 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" podUID="20680c56-a79c-432b-9104-d57ad11cb244" containerName="manager" containerID="cri-o://29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e" gracePeriod=10 Jun 07 19:36:52.194584 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.194557 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:52.269376 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.269342 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20680c56-a79c-432b-9104-d57ad11cb244-extensions-socket-volume\") pod \"20680c56-a79c-432b-9104-d57ad11cb244\" (UID: \"20680c56-a79c-432b-9104-d57ad11cb244\") " Jun 07 19:36:52.269562 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.269444 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fd6z\" (UniqueName: \"kubernetes.io/projected/20680c56-a79c-432b-9104-d57ad11cb244-kube-api-access-5fd6z\") pod \"20680c56-a79c-432b-9104-d57ad11cb244\" (UID: \"20680c56-a79c-432b-9104-d57ad11cb244\") " Jun 07 19:36:52.269635 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.269612 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20680c56-a79c-432b-9104-d57ad11cb244-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "20680c56-a79c-432b-9104-d57ad11cb244" (UID: "20680c56-a79c-432b-9104-d57ad11cb244"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:36:52.269724 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.269712 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20680c56-a79c-432b-9104-d57ad11cb244-extensions-socket-volume\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:36:52.271406 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.271384 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20680c56-a79c-432b-9104-d57ad11cb244-kube-api-access-5fd6z" (OuterVolumeSpecName: "kube-api-access-5fd6z") pod "20680c56-a79c-432b-9104-d57ad11cb244" (UID: "20680c56-a79c-432b-9104-d57ad11cb244"). InnerVolumeSpecName "kube-api-access-5fd6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:36:52.370398 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.370361 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fd6z\" (UniqueName: \"kubernetes.io/projected/20680c56-a79c-432b-9104-d57ad11cb244-kube-api-access-5fd6z\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:36:52.951454 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.951387 2562 generic.go:356] "Generic (PLEG): container finished" podID="20680c56-a79c-432b-9104-d57ad11cb244" containerID="29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e" exitCode=0 Jun 07 19:36:52.951872 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.951463 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" Jun 07 19:36:52.951872 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.951470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" event={"ID":"20680c56-a79c-432b-9104-d57ad11cb244","Type":"ContainerDied","Data":"29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e"} Jun 07 19:36:52.951872 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.951521 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh" event={"ID":"20680c56-a79c-432b-9104-d57ad11cb244","Type":"ContainerDied","Data":"fc4044b2bd55de1952f52a5f929bd2c69d0c97f590bae02a5a0ceda2239fba44"} Jun 07 19:36:52.951872 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.951542 2562 scope.go:117] "RemoveContainer" containerID="29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e" Jun 07 19:36:52.960557 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.960502 2562 scope.go:117] "RemoveContainer" containerID="29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e" Jun 07 19:36:52.960752 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:36:52.960736 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e\": container with ID starting with 29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e not found: ID does not exist" containerID="29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e" Jun 07 19:36:52.960803 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.960760 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e"} err="failed to get container status \"29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e\": rpc error: code = NotFound desc = could not find container \"29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e\": container with ID starting with 29cd37565923e8ad24ca66fb99f7c55694e472346594963c5baeccfa3e967e6e not found: ID does not exist" Jun 07 19:36:52.970053 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.970030 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh"] Jun 07 19:36:52.975570 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:52.975545 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7grvh"] Jun 07 19:36:53.095191 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:53.095093 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:53.195292 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:53.195252 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:54.078202 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:54.078165 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:54.177942 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:54.177899 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:54.760353 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:54.760320 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20680c56-a79c-432b-9104-d57ad11cb244" path="/var/lib/kubelet/pods/20680c56-a79c-432b-9104-d57ad11cb244/volumes" Jun 07 19:36:56.324003 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:56.323969 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:56.424647 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:56.424615 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:36:59.660812 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:36:59.660775 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:00.480859 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:00.480818 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:00.580989 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:00.580952 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:11.309506 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.309472 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:11.408456 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.408393 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:11.508483 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.508449 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:11.699617 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.699527 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xjhhk"] Jun 07 19:37:11.699993 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.699973 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20680c56-a79c-432b-9104-d57ad11cb244" containerName="manager" Jun 07 19:37:11.700086 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.699995 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="20680c56-a79c-432b-9104-d57ad11cb244" containerName="manager" Jun 07 19:37:11.700140 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.700099 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="20680c56-a79c-432b-9104-d57ad11cb244" containerName="manager" Jun 07 19:37:11.704255 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.704231 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" Jun 07 19:37:11.706587 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.706562 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 07 19:37:11.706702 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.706627 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6dzjf\"" Jun 07 19:37:11.710608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.710587 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xjhhk"] Jun 07 19:37:11.738977 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.738941 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xjhhk"] Jun 07 19:37:11.840237 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.840206 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5ea46e4f-1a73-4801-94e9-0dbd31bbef1f-config-file\") pod \"limitador-limitador-54d6d988d5-xjhhk\" (UID: \"5ea46e4f-1a73-4801-94e9-0dbd31bbef1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" Jun 07 19:37:11.840397 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.840261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4765\" (UniqueName: \"kubernetes.io/projected/5ea46e4f-1a73-4801-94e9-0dbd31bbef1f-kube-api-access-x4765\") pod \"limitador-limitador-54d6d988d5-xjhhk\" (UID: \"5ea46e4f-1a73-4801-94e9-0dbd31bbef1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" Jun 07 19:37:11.941081 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.941047 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5ea46e4f-1a73-4801-94e9-0dbd31bbef1f-config-file\") pod \"limitador-limitador-54d6d988d5-xjhhk\" (UID: \"5ea46e4f-1a73-4801-94e9-0dbd31bbef1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" Jun 07 19:37:11.941218 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.941099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4765\" (UniqueName: \"kubernetes.io/projected/5ea46e4f-1a73-4801-94e9-0dbd31bbef1f-kube-api-access-x4765\") pod \"limitador-limitador-54d6d988d5-xjhhk\" (UID: \"5ea46e4f-1a73-4801-94e9-0dbd31bbef1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" Jun 07 19:37:11.941785 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.941766 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5ea46e4f-1a73-4801-94e9-0dbd31bbef1f-config-file\") pod \"limitador-limitador-54d6d988d5-xjhhk\" (UID: \"5ea46e4f-1a73-4801-94e9-0dbd31bbef1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" Jun 07 19:37:11.948546 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:11.948519 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4765\" (UniqueName: \"kubernetes.io/projected/5ea46e4f-1a73-4801-94e9-0dbd31bbef1f-kube-api-access-x4765\") pod \"limitador-limitador-54d6d988d5-xjhhk\" (UID: \"5ea46e4f-1a73-4801-94e9-0dbd31bbef1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" Jun 07 19:37:12.015586 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:12.015495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" Jun 07 19:37:12.133311 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:12.133218 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:12.152735 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:12.152711 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xjhhk"] Jun 07 19:37:12.154589 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:37:12.154562 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea46e4f_1a73_4801_94e9_0dbd31bbef1f.slice/crio-d90955700a27a269c98a11603be4aa9088afb5aa1e974dd9c33f84a76f5b61e1 WatchSource:0}: Error finding container d90955700a27a269c98a11603be4aa9088afb5aa1e974dd9c33f84a76f5b61e1: Status 404 returned error can't find the container with id d90955700a27a269c98a11603be4aa9088afb5aa1e974dd9c33f84a76f5b61e1 Jun 07 19:37:12.233048 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:12.233020 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:13.069275 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:13.069237 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" event={"ID":"5ea46e4f-1a73-4801-94e9-0dbd31bbef1f","Type":"ContainerStarted","Data":"d90955700a27a269c98a11603be4aa9088afb5aa1e974dd9c33f84a76f5b61e1"} Jun 07 19:37:14.971311 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:14.971234 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86849f4b66-l8qsc"] Jun 07 19:37:14.974897 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:14.974876 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:14.993267 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:14.993242 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86849f4b66-l8qsc"] Jun 07 19:37:15.036561 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.036523 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:15.069432 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.069391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-service-ca\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.069567 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.069449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29efa5fd-96cc-4b05-b1df-458997a5a70e-console-serving-cert\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.069567 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.069470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29efa5fd-96cc-4b05-b1df-458997a5a70e-console-oauth-config\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.069567 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.069504 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-console-config\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.069567 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.069521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cbhv\" (UniqueName: \"kubernetes.io/projected/29efa5fd-96cc-4b05-b1df-458997a5a70e-kube-api-access-9cbhv\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.069567 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.069538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-oauth-serving-cert\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.069791 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.069592 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-trusted-ca-bundle\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.082614 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.082585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" event={"ID":"5ea46e4f-1a73-4801-94e9-0dbd31bbef1f","Type":"ContainerStarted","Data":"93ac6df406a4ed8f500be8bad3275a8b4e067eccfa12267681cd3e66fbf7dfaf"} Jun 07 19:37:15.082741 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.082708 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" Jun 07 19:37:15.093690 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.093657 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:15.099638 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.099597 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" podStartSLOduration=1.5764627949999999 podStartE2EDuration="4.099583671s" totalImagesPullingTime="2.523120876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:37:15.097572291 +0000 UTC m=+462.772597189" watchObservedRunningTime="2026-06-07 19:37:15.099583671 +0000 UTC m=+462.774608568" Jun 07 19:37:15.170736 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.170711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29efa5fd-96cc-4b05-b1df-458997a5a70e-console-serving-cert\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.170868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.170742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29efa5fd-96cc-4b05-b1df-458997a5a70e-console-oauth-config\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.170868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.170763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-console-config\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.170868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.170780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbhv\" (UniqueName: \"kubernetes.io/projected/29efa5fd-96cc-4b05-b1df-458997a5a70e-kube-api-access-9cbhv\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.170868 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.170804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-oauth-serving-cert\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.171083 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.170878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-trusted-ca-bundle\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.171083 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.170933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-service-ca\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.171575 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.171549 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-console-config\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.171724 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.171706 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-service-ca\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.171896 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.171875 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-trusted-ca-bundle\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.171941 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.171875 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29efa5fd-96cc-4b05-b1df-458997a5a70e-oauth-serving-cert\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.173334 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.173308 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29efa5fd-96cc-4b05-b1df-458997a5a70e-console-oauth-config\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.173437 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.173377 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29efa5fd-96cc-4b05-b1df-458997a5a70e-console-serving-cert\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.178371 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.178352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cbhv\" (UniqueName: \"kubernetes.io/projected/29efa5fd-96cc-4b05-b1df-458997a5a70e-kube-api-access-9cbhv\") pod \"console-86849f4b66-l8qsc\" (UID: \"29efa5fd-96cc-4b05-b1df-458997a5a70e\") " pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.284860 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.284824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:15.421719 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:15.421692 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86849f4b66-l8qsc"] Jun 07 19:37:15.422689 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:37:15.422663 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29efa5fd_96cc_4b05_b1df_458997a5a70e.slice/crio-5ecba73a14ea0b1e3158cf1eb9badf50a02d40a93d4115f197561490f3332b80 WatchSource:0}: Error finding container 5ecba73a14ea0b1e3158cf1eb9badf50a02d40a93d4115f197561490f3332b80: Status 404 returned error can't find the container with id 5ecba73a14ea0b1e3158cf1eb9badf50a02d40a93d4115f197561490f3332b80 Jun 07 19:37:16.090176 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:16.090139 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86849f4b66-l8qsc" event={"ID":"29efa5fd-96cc-4b05-b1df-458997a5a70e","Type":"ContainerStarted","Data":"e39eac8f2667e2343e1cbfb0ef5156ce606f49a3d6454ff6a912c2c921adf2a4"} Jun 07 19:37:16.090573 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:16.090191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86849f4b66-l8qsc" event={"ID":"29efa5fd-96cc-4b05-b1df-458997a5a70e","Type":"ContainerStarted","Data":"5ecba73a14ea0b1e3158cf1eb9badf50a02d40a93d4115f197561490f3332b80"} Jun 07 19:37:16.106985 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:16.106937 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86849f4b66-l8qsc" podStartSLOduration=2.106921664 podStartE2EDuration="2.106921664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:37:16.105447501 +0000 UTC m=+463.780472398" watchObservedRunningTime="2026-06-07 19:37:16.106921664 +0000 UTC m=+463.781946563" Jun 07 19:37:25.285383 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:25.285339 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:25.285835 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:25.285497 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:25.290269 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:25.290247 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:26.091807 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:26.091779 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xjhhk" Jun 07 19:37:26.154208 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:26.154173 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86849f4b66-l8qsc" Jun 07 19:37:26.197699 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:26.197668 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566d5496d6-j62dh"] Jun 07 19:37:26.319441 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:26.319394 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:26.369216 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:26.369125 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:32.167608 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:32.167566 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:32.265071 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:32.265031 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:32.661134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:32.661098 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:42.640312 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:42.640275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:42.739614 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:42.739571 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:42.899939 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:42.899844 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:37:43.697459 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.697423 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd"] Jun 07 19:37:43.702338 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.702318 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:43.705060 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.705040 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 19:37:43.706227 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.706207 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 19:37:43.706351 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.706214 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t7bnf\"" Jun 07 19:37:43.709042 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.709023 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd"] Jun 07 19:37:43.725944 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.725920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:43.726068 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.725954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2crh9\" (UniqueName: \"kubernetes.io/projected/d9f4244f-81e7-4c49-94cc-34b613c1fd14-kube-api-access-2crh9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:43.726068 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.726028 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:43.826652 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.826616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:43.826807 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.826696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:43.826807 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.826717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2crh9\" (UniqueName: \"kubernetes.io/projected/d9f4244f-81e7-4c49-94cc-34b613c1fd14-kube-api-access-2crh9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:43.827036 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.827016 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:43.827080 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.827039 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:43.836359 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:43.836331 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2crh9\" (UniqueName: \"kubernetes.io/projected/d9f4244f-81e7-4c49-94cc-34b613c1fd14-kube-api-access-2crh9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:44.013637 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:44.013556 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:44.151249 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:44.151219 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd"] Jun 07 19:37:44.151635 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:37:44.151610 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f4244f_81e7_4c49_94cc_34b613c1fd14.slice/crio-2e28af2643226c4a8788ebcc8e42cb949ba084f0cb6c0b8d6551b4a669b70256 WatchSource:0}: Error finding container 2e28af2643226c4a8788ebcc8e42cb949ba084f0cb6c0b8d6551b4a669b70256: Status 404 returned error can't find the container with id 2e28af2643226c4a8788ebcc8e42cb949ba084f0cb6c0b8d6551b4a669b70256 Jun 07 19:37:44.252399 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:44.252367 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" event={"ID":"d9f4244f-81e7-4c49-94cc-34b613c1fd14","Type":"ContainerStarted","Data":"333dc65d27a0e1646d08d411889611ab9a70acabfbec6e09f482118ead2e9af6"} Jun 07 19:37:44.252546 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:44.252444 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" event={"ID":"d9f4244f-81e7-4c49-94cc-34b613c1fd14","Type":"ContainerStarted","Data":"2e28af2643226c4a8788ebcc8e42cb949ba084f0cb6c0b8d6551b4a669b70256"} Jun 07 19:37:45.259914 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:45.259823 2562 generic.go:356] "Generic (PLEG): container finished" podID="d9f4244f-81e7-4c49-94cc-34b613c1fd14" containerID="333dc65d27a0e1646d08d411889611ab9a70acabfbec6e09f482118ead2e9af6" exitCode=0 Jun 07 19:37:45.260317 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:45.259916 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" event={"ID":"d9f4244f-81e7-4c49-94cc-34b613c1fd14","Type":"ContainerDied","Data":"333dc65d27a0e1646d08d411889611ab9a70acabfbec6e09f482118ead2e9af6"} Jun 07 19:37:46.267050 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:46.267013 2562 generic.go:356] "Generic (PLEG): container finished" podID="d9f4244f-81e7-4c49-94cc-34b613c1fd14" containerID="e9d4b40465e5db88276ee3e1a8c72b820f749e6f80736c2a78a5946cf246c378" exitCode=0 Jun 07 19:37:46.267409 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:46.267068 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" event={"ID":"d9f4244f-81e7-4c49-94cc-34b613c1fd14","Type":"ContainerDied","Data":"e9d4b40465e5db88276ee3e1a8c72b820f749e6f80736c2a78a5946cf246c378"} Jun 07 19:37:47.279060 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:47.279018 2562 generic.go:356] "Generic (PLEG): container finished" podID="d9f4244f-81e7-4c49-94cc-34b613c1fd14" containerID="bfa9b04b09d5c3c806d95da86fe025ef03fa70cbcbdc09ef9f4a6b9b4cb8db82" exitCode=0 Jun 07 19:37:47.279490 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:47.279094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" event={"ID":"d9f4244f-81e7-4c49-94cc-34b613c1fd14","Type":"ContainerDied","Data":"bfa9b04b09d5c3c806d95da86fe025ef03fa70cbcbdc09ef9f4a6b9b4cb8db82"} Jun 07 19:37:48.424177 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:48.424149 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:48.459750 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:48.459715 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-bundle\") pod \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " Jun 07 19:37:48.459925 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:48.459783 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-util\") pod \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " Jun 07 19:37:48.459925 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:48.459862 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2crh9\" (UniqueName: \"kubernetes.io/projected/d9f4244f-81e7-4c49-94cc-34b613c1fd14-kube-api-access-2crh9\") pod \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\" (UID: \"d9f4244f-81e7-4c49-94cc-34b613c1fd14\") " Jun 07 19:37:48.460331 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:48.460290 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-bundle" (OuterVolumeSpecName: "bundle") pod "d9f4244f-81e7-4c49-94cc-34b613c1fd14" (UID: "d9f4244f-81e7-4c49-94cc-34b613c1fd14"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:37:48.462001 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:48.461976 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9f4244f-81e7-4c49-94cc-34b613c1fd14-kube-api-access-2crh9" (OuterVolumeSpecName: "kube-api-access-2crh9") pod "d9f4244f-81e7-4c49-94cc-34b613c1fd14" (UID: "d9f4244f-81e7-4c49-94cc-34b613c1fd14"). InnerVolumeSpecName "kube-api-access-2crh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:37:48.465910 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:48.465871 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-util" (OuterVolumeSpecName: "util") pod "d9f4244f-81e7-4c49-94cc-34b613c1fd14" (UID: "d9f4244f-81e7-4c49-94cc-34b613c1fd14"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:37:48.560461 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:48.560355 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-util\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:37:48.560461 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:48.560385 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2crh9\" (UniqueName: \"kubernetes.io/projected/d9f4244f-81e7-4c49-94cc-34b613c1fd14-kube-api-access-2crh9\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:37:48.560461 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:48.560395 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9f4244f-81e7-4c49-94cc-34b613c1fd14-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:37:49.293133 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:49.293105 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" Jun 07 19:37:49.293133 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:49.293117 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74862trd" event={"ID":"d9f4244f-81e7-4c49-94cc-34b613c1fd14","Type":"ContainerDied","Data":"2e28af2643226c4a8788ebcc8e42cb949ba084f0cb6c0b8d6551b4a669b70256"} Jun 07 19:37:49.293340 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:49.293165 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e28af2643226c4a8788ebcc8e42cb949ba084f0cb6c0b8d6551b4a669b70256" Jun 07 19:37:51.218214 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.218173 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-566d5496d6-j62dh" podUID="8d8913f5-1680-48f0-8571-b65040f5c3b5" containerName="console" containerID="cri-o://3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d" gracePeriod=15 Jun 07 19:37:51.461256 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.461234 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:37:51.477448 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.477358 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-serving-cert\") pod \"8d8913f5-1680-48f0-8571-b65040f5c3b5\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " Jun 07 19:37:51.477448 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.477407 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-oauth-config\") pod \"8d8913f5-1680-48f0-8571-b65040f5c3b5\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " Jun 07 19:37:51.477640 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.477455 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-service-ca\") pod \"8d8913f5-1680-48f0-8571-b65040f5c3b5\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " Jun 07 19:37:51.477640 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.477494 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-oauth-serving-cert\") pod \"8d8913f5-1680-48f0-8571-b65040f5c3b5\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " Jun 07 19:37:51.477640 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.477526 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-trusted-ca-bundle\") pod \"8d8913f5-1680-48f0-8571-b65040f5c3b5\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " Jun 07 19:37:51.477640 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.477555 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-config\") pod \"8d8913f5-1680-48f0-8571-b65040f5c3b5\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " Jun 07 19:37:51.477640 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.477600 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw2s7\" (UniqueName: \"kubernetes.io/projected/8d8913f5-1680-48f0-8571-b65040f5c3b5-kube-api-access-fw2s7\") pod \"8d8913f5-1680-48f0-8571-b65040f5c3b5\" (UID: \"8d8913f5-1680-48f0-8571-b65040f5c3b5\") " Jun 07 19:37:51.477894 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.477810 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-service-ca" (OuterVolumeSpecName: "service-ca") pod "8d8913f5-1680-48f0-8571-b65040f5c3b5" (UID: "8d8913f5-1680-48f0-8571-b65040f5c3b5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:37:51.477990 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.477956 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-service-ca\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:37:51.478047 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.477983 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8d8913f5-1680-48f0-8571-b65040f5c3b5" (UID: "8d8913f5-1680-48f0-8571-b65040f5c3b5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:37:51.478252 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.478211 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-config" (OuterVolumeSpecName: "console-config") pod "8d8913f5-1680-48f0-8571-b65040f5c3b5" (UID: "8d8913f5-1680-48f0-8571-b65040f5c3b5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:37:51.478360 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.478332 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8d8913f5-1680-48f0-8571-b65040f5c3b5" (UID: "8d8913f5-1680-48f0-8571-b65040f5c3b5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:37:51.479918 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.479880 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8d8913f5-1680-48f0-8571-b65040f5c3b5" (UID: "8d8913f5-1680-48f0-8571-b65040f5c3b5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:37:51.480135 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.480109 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8d8913f5-1680-48f0-8571-b65040f5c3b5" (UID: "8d8913f5-1680-48f0-8571-b65040f5c3b5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:37:51.480135 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.480128 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d8913f5-1680-48f0-8571-b65040f5c3b5-kube-api-access-fw2s7" (OuterVolumeSpecName: "kube-api-access-fw2s7") pod "8d8913f5-1680-48f0-8571-b65040f5c3b5" (UID: "8d8913f5-1680-48f0-8571-b65040f5c3b5"). InnerVolumeSpecName "kube-api-access-fw2s7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:37:51.578753 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.578725 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:37:51.578753 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.578749 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-oauth-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:37:51.578753 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.578758 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-oauth-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:37:51.578973 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.578767 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-trusted-ca-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:37:51.578973 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.578777 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d8913f5-1680-48f0-8571-b65040f5c3b5-console-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:37:51.578973 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:51.578786 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw2s7\" (UniqueName: \"kubernetes.io/projected/8d8913f5-1680-48f0-8571-b65040f5c3b5-kube-api-access-fw2s7\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jun 07 19:37:52.311831 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:52.311801 2562 generic.go:356] "Generic (PLEG): container finished" podID="8d8913f5-1680-48f0-8571-b65040f5c3b5" containerID="3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d" exitCode=0 Jun 07 19:37:52.312216 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:52.311851 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566d5496d6-j62dh" Jun 07 19:37:52.312216 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:52.311889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566d5496d6-j62dh" event={"ID":"8d8913f5-1680-48f0-8571-b65040f5c3b5","Type":"ContainerDied","Data":"3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d"} Jun 07 19:37:52.312216 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:52.311942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566d5496d6-j62dh" event={"ID":"8d8913f5-1680-48f0-8571-b65040f5c3b5","Type":"ContainerDied","Data":"7915d14aeffaa1eacddfd131180d3c4546bb2f5ead3bc75aa0ea5171922c768b"} Jun 07 19:37:52.312216 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:52.311967 2562 scope.go:117] "RemoveContainer" containerID="3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d" Jun 07 19:37:52.326304 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:52.326280 2562 scope.go:117] "RemoveContainer" containerID="3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d" Jun 07 19:37:52.326588 ip-10-0-128-213 kubenswrapper[2562]: E0607 19:37:52.326571 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d\": container with ID starting with 3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d not found: ID does not exist" containerID="3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d" Jun 07 19:37:52.326654 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:52.326595 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d"} err="failed to get container status \"3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d\": rpc error: code = NotFound desc = could not find container \"3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d\": container with ID starting with 3f4c581ba20aa1e1c82ba636b4223b39dbc29b24cff1efa469686a1ae01c536d not found: ID does not exist" Jun 07 19:37:52.336396 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:52.336374 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566d5496d6-j62dh"] Jun 07 19:37:52.338579 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:52.338559 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-566d5496d6-j62dh"] Jun 07 19:37:52.760864 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:37:52.760784 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d8913f5-1680-48f0-8571-b65040f5c3b5" path="/var/lib/kubelet/pods/8d8913f5-1680-48f0-8571-b65040f5c3b5/volumes" Jun 07 19:38:11.976887 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:11.976853 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:38:12.024375 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:12.024346 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:38:25.328891 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:25.328857 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:38:32.723814 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:32.723779 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:38:41.434211 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:41.434171 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:38:42.036010 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:42.035957 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:38:47.110991 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.110951 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:38:47.191787 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.191756 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:38:47.271546 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.271517 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:38:47.276533 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.276510 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59c768d774-jk7l2"] Jun 07 19:38:47.276902 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.276890 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d8913f5-1680-48f0-8571-b65040f5c3b5" containerName="console" Jun 07 19:38:47.276946 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.276905 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d8913f5-1680-48f0-8571-b65040f5c3b5" containerName="console" Jun 07 19:38:47.276946 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.276916 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9f4244f-81e7-4c49-94cc-34b613c1fd14" containerName="util" Jun 07 19:38:47.276946 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.276922 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9f4244f-81e7-4c49-94cc-34b613c1fd14" containerName="util" Jun 07 19:38:47.276946 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.276937 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9f4244f-81e7-4c49-94cc-34b613c1fd14" containerName="extract" Jun 07 19:38:47.277072 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.276946 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9f4244f-81e7-4c49-94cc-34b613c1fd14" containerName="extract" Jun 07 19:38:47.277072 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.276958 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9f4244f-81e7-4c49-94cc-34b613c1fd14" containerName="pull" Jun 07 19:38:47.277072 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.276964 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9f4244f-81e7-4c49-94cc-34b613c1fd14" containerName="pull" Jun 07 19:38:47.277072 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.277035 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9f4244f-81e7-4c49-94cc-34b613c1fd14" containerName="extract" Jun 07 19:38:47.277072 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.277045 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d8913f5-1680-48f0-8571-b65040f5c3b5" containerName="console" Jun 07 19:38:47.281657 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.281642 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c768d774-jk7l2" Jun 07 19:38:47.284353 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.284324 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 07 19:38:47.285672 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.285649 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fthw7\"" Jun 07 19:38:47.285785 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.285688 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 07 19:38:47.288930 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.288907 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59c768d774-jk7l2"] Jun 07 19:38:47.361246 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.361171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6hvg\" (UniqueName: \"kubernetes.io/projected/0eb03447-861e-435d-917c-dc6bc104e1be-kube-api-access-w6hvg\") pod \"maas-controller-59c768d774-jk7l2\" (UID: \"0eb03447-861e-435d-917c-dc6bc104e1be\") " pod="opendatahub/maas-controller-59c768d774-jk7l2" Jun 07 19:38:47.361246 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.361208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0eb03447-861e-435d-917c-dc6bc104e1be-webhook-cert\") pod \"maas-controller-59c768d774-jk7l2\" (UID: \"0eb03447-861e-435d-917c-dc6bc104e1be\") " pod="opendatahub/maas-controller-59c768d774-jk7l2" Jun 07 19:38:47.462429 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.462391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6hvg\" (UniqueName: \"kubernetes.io/projected/0eb03447-861e-435d-917c-dc6bc104e1be-kube-api-access-w6hvg\") pod \"maas-controller-59c768d774-jk7l2\" (UID: \"0eb03447-861e-435d-917c-dc6bc104e1be\") " pod="opendatahub/maas-controller-59c768d774-jk7l2" Jun 07 19:38:47.462639 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.462457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0eb03447-861e-435d-917c-dc6bc104e1be-webhook-cert\") pod \"maas-controller-59c768d774-jk7l2\" (UID: \"0eb03447-861e-435d-917c-dc6bc104e1be\") " pod="opendatahub/maas-controller-59c768d774-jk7l2" Jun 07 19:38:47.464907 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.464885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0eb03447-861e-435d-917c-dc6bc104e1be-webhook-cert\") pod \"maas-controller-59c768d774-jk7l2\" (UID: \"0eb03447-861e-435d-917c-dc6bc104e1be\") " pod="opendatahub/maas-controller-59c768d774-jk7l2" Jun 07 19:38:47.470052 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.470029 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6hvg\" (UniqueName: \"kubernetes.io/projected/0eb03447-861e-435d-917c-dc6bc104e1be-kube-api-access-w6hvg\") pod \"maas-controller-59c768d774-jk7l2\" (UID: \"0eb03447-861e-435d-917c-dc6bc104e1be\") " pod="opendatahub/maas-controller-59c768d774-jk7l2" Jun 07 19:38:47.594290 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.594258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c768d774-jk7l2" Jun 07 19:38:47.725492 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:47.725470 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59c768d774-jk7l2"] Jun 07 19:38:47.727052 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:38:47.727023 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb03447_861e_435d_917c_dc6bc104e1be.slice/crio-216550bc07d8ec69c0ba74d130a2fe58ab00992ea266e2de850496c307561866 WatchSource:0}: Error finding container 216550bc07d8ec69c0ba74d130a2fe58ab00992ea266e2de850496c307561866: Status 404 returned error can't find the container with id 216550bc07d8ec69c0ba74d130a2fe58ab00992ea266e2de850496c307561866 Jun 07 19:38:48.628752 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:48.628708 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c768d774-jk7l2" event={"ID":"0eb03447-861e-435d-917c-dc6bc104e1be","Type":"ContainerStarted","Data":"216550bc07d8ec69c0ba74d130a2fe58ab00992ea266e2de850496c307561866"} Jun 07 19:38:50.196884 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:50.196791 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:38:50.295207 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:50.295164 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:38:50.643270 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:50.643181 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c768d774-jk7l2" event={"ID":"0eb03447-861e-435d-917c-dc6bc104e1be","Type":"ContainerStarted","Data":"493e9f10667eab4bdb360511f67e79d64fc3563dcf578c119dea44fc1e0e99e6"} Jun 07 19:38:50.643451 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:50.643353 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59c768d774-jk7l2" Jun 07 19:38:50.663658 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:38:50.663608 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59c768d774-jk7l2" podStartSLOduration=1.394325771 podStartE2EDuration="3.663592061s" totalImagesPullingTime="2.26926629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:38:50.660888052 +0000 UTC m=+558.335912973" watchObservedRunningTime="2026-06-07 19:38:50.663592061 +0000 UTC m=+558.338616959" Jun 07 19:39:01.653747 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:39:01.653716 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59c768d774-jk7l2" Jun 07 19:39:22.168295 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:39:22.168265 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:39:32.757822 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:39:32.757796 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:39:32.758971 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:39:32.758947 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:39:53.388107 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:39:53.388019 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:40:07.885994 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:40:07.885953 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:41:18.118538 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:41:18.118459 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:41:18.216095 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:41:18.216055 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:43:10.154194 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:43:10.154156 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:43:10.243128 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:43:10.243087 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:43:29.863903 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:43:29.863871 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:44:32.793158 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:44:32.793089 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:44:32.796858 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:44:32.796834 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:45:31.310877 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:45:31.310820 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:49:11.480486 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:11.480408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:49:12.302134 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:12.302097 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-68c5d99799-998hf_57449cbe-7f17-4116-abde-4f5f950bfc12/nginx/0.log" Jun 07 19:49:12.535108 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:12.535070 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-4kfbm_298eaf22-ad6f-4071-9ec2-8c133301a776/manager/0.log" Jun 07 19:49:12.655504 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:12.655368 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4pzt9_8a92fe1f-d620-4b54-92b6-ceade69fa7ce/manager/0.log" Jun 07 19:49:12.767171 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:12.767129 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59c768d774-jk7l2_0eb03447-861e-435d-917c-dc6bc104e1be/manager/0.log" Jun 07 19:49:12.874396 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:12.874367 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-lzhs6_5405729f-fc0d-4ab8-af8d-7730984743b1/server/0.log" Jun 07 19:49:13.230008 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:13.229977 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-544b9844c8-fnjxx_b0eaf737-5fa2-4705-9de5-5771272d6687/copy-manifests/0.log" Jun 07 19:49:13.236557 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:13.236535 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-544b9844c8-fnjxx_b0eaf737-5fa2-4705-9de5-5771272d6687/manager/0.log" Jun 07 19:49:14.097229 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.097197 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh_f6daf854-db69-4058-8c39-47ce600cef84/util/0.log" Jun 07 19:49:14.103166 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.103145 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh_f6daf854-db69-4058-8c39-47ce600cef84/pull/0.log" Jun 07 19:49:14.109206 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.109186 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh_f6daf854-db69-4058-8c39-47ce600cef84/extract/0.log" Jun 07 19:49:14.219779 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.219746 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4_753b3b44-a366-4024-92e1-9bb29605054f/util/0.log" Jun 07 19:49:14.226151 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.226123 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4_753b3b44-a366-4024-92e1-9bb29605054f/pull/0.log" Jun 07 19:49:14.232087 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.232072 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4_753b3b44-a366-4024-92e1-9bb29605054f/extract/0.log" Jun 07 19:49:14.338845 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.338813 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68_a00e7b05-e4c9-4c2c-8549-e5c23962c8d6/extract/0.log" Jun 07 19:49:14.344644 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.344625 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68_a00e7b05-e4c9-4c2c-8549-e5c23962c8d6/util/0.log" Jun 07 19:49:14.350330 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.350281 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68_a00e7b05-e4c9-4c2c-8549-e5c23962c8d6/pull/0.log" Jun 07 19:49:14.457021 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.456993 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw_f60cc854-d431-4d19-b6e0-86fcaa2737ff/util/0.log" Jun 07 19:49:14.462858 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.462836 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw_f60cc854-d431-4d19-b6e0-86fcaa2737ff/pull/0.log" Jun 07 19:49:14.468660 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.468640 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw_f60cc854-d431-4d19-b6e0-86fcaa2737ff/extract/0.log" Jun 07 19:49:14.800904 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:14.800881 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tsdkf_6cab621c-f31b-4075-be4b-f091eaad46e9/manager/0.log" Jun 07 19:49:15.021496 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:15.021462 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dt4d2_7ceef642-b122-42d4-8a5b-6661b34b8715/registry-server/0.log" Jun 07 19:49:15.134143 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:15.134068 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tsjth_5c9351d2-5053-487c-bb4f-c3e6fd021687/manager/0.log" Jun 07 19:49:15.242283 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:15.242258 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xjhhk_5ea46e4f-1a73-4801-94e9-0dbd31bbef1f/limitador/0.log" Jun 07 19:49:15.789732 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:15.789703 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6xrv7_eaf808f2-397c-4553-802f-2d695f1ae99f/discovery/0.log" Jun 07 19:49:16.005051 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:16.005021 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d6d9c57f7-bg58x_0734007c-8c47-4447-9b7f-67d43ef3febc/kube-auth-proxy/0.log" Jun 07 19:49:20.485321 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:20.485285 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:49:20.587787 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:20.587755 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" limit=1024 Jun 07 19:49:23.344615 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:23.344571 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7d8dl_1cc9010f-e635-417d-8648-16996ea61a8d/global-pull-secret-syncer/0.log" Jun 07 19:49:23.465087 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:23.465057 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mcnhd_64239ea5-bafa-4f7c-a183-232428d1c219/konnectivity-agent/0.log" Jun 07 19:49:23.544201 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:23.544173 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-213.ec2.internal_3a8c5dee304fa10b5807d1a06407eb73/haproxy/0.log" Jun 07 19:49:27.412453 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:27.412408 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-l2j2v_691af11f-869b-4d94-9171-3aebe539bce5/sail-operator/0.log" Jun 07 19:49:27.915796 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:27.915759 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh_f6daf854-db69-4058-8c39-47ce600cef84/extract/0.log" Jun 07 19:49:27.942432 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:27.942384 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh_f6daf854-db69-4058-8c39-47ce600cef84/util/0.log" Jun 07 19:49:27.962245 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:27.962223 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kckqh_f6daf854-db69-4058-8c39-47ce600cef84/pull/0.log" Jun 07 19:49:28.013536 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.013506 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4_753b3b44-a366-4024-92e1-9bb29605054f/extract/0.log" Jun 07 19:49:28.032848 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.032818 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4_753b3b44-a366-4024-92e1-9bb29605054f/util/0.log" Jun 07 19:49:28.053994 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.053969 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06mrz4_753b3b44-a366-4024-92e1-9bb29605054f/pull/0.log" Jun 07 19:49:28.087890 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.087840 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68_a00e7b05-e4c9-4c2c-8549-e5c23962c8d6/extract/0.log" Jun 07 19:49:28.113306 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.113280 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68_a00e7b05-e4c9-4c2c-8549-e5c23962c8d6/util/0.log" Jun 07 19:49:28.134538 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.134513 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rcn68_a00e7b05-e4c9-4c2c-8549-e5c23962c8d6/pull/0.log" Jun 07 19:49:28.161147 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.161121 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw_f60cc854-d431-4d19-b6e0-86fcaa2737ff/extract/0.log" Jun 07 19:49:28.181250 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.181168 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw_f60cc854-d431-4d19-b6e0-86fcaa2737ff/util/0.log" Jun 07 19:49:28.202046 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.202019 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5fhw_f60cc854-d431-4d19-b6e0-86fcaa2737ff/pull/0.log" Jun 07 19:49:28.305989 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.305962 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tsdkf_6cab621c-f31b-4075-be4b-f091eaad46e9/manager/0.log" Jun 07 19:49:28.362830 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.362802 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dt4d2_7ceef642-b122-42d4-8a5b-6661b34b8715/registry-server/0.log" Jun 07 19:49:28.398315 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.398289 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tsjth_5c9351d2-5053-487c-bb4f-c3e6fd021687/manager/0.log" Jun 07 19:49:28.418458 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:28.418432 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xjhhk_5ea46e4f-1a73-4801-94e9-0dbd31bbef1f/limitador/0.log" Jun 07 19:49:30.364045 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:30.364017 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-488qc_bd54a62e-a621-42ba-b7ca-27725b0e5e32/kube-state-metrics/0.log" Jun 07 19:49:30.386499 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:30.386476 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-488qc_bd54a62e-a621-42ba-b7ca-27725b0e5e32/kube-rbac-proxy-main/0.log" Jun 07 19:49:30.411301 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:30.411272 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-488qc_bd54a62e-a621-42ba-b7ca-27725b0e5e32/kube-rbac-proxy-self/0.log" Jun 07 19:49:30.479247 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:30.479219 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-mj47n_70e4df2e-82ab-4775-936e-23b3446d8c53/monitoring-plugin/0.log" Jun 07 19:49:30.706949 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:30.706872 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2dcj_dbf82a39-9d8a-434c-8a75-9cde12c4b129/node-exporter/0.log" Jun 07 19:49:30.725328 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:30.725305 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2dcj_dbf82a39-9d8a-434c-8a75-9cde12c4b129/kube-rbac-proxy/0.log" Jun 07 19:49:30.745248 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:30.745228 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2dcj_dbf82a39-9d8a-434c-8a75-9cde12c4b129/init-textfile/0.log" Jun 07 19:49:30.768292 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:30.768264 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4rp4n_236a31f7-ee63-421e-a91e-1150773b15c8/kube-rbac-proxy-main/0.log" Jun 07 19:49:30.790152 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:30.790129 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4rp4n_236a31f7-ee63-421e-a91e-1150773b15c8/kube-rbac-proxy-self/0.log" Jun 07 19:49:30.813746 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:30.813718 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4rp4n_236a31f7-ee63-421e-a91e-1150773b15c8/openshift-state-metrics/0.log" Jun 07 19:49:31.046428 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:31.046377 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-f8hfq_904294c2-de36-4868-b506-fbea70cf8812/prometheus-operator/0.log" Jun 07 19:49:31.066689 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:31.066668 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-f8hfq_904294c2-de36-4868-b506-fbea70cf8812/kube-rbac-proxy/0.log" Jun 07 19:49:31.090522 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:31.090495 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-m6xwx_fe4ba456-a67c-44a8-a02c-7caa695bd961/prometheus-operator-admission-webhook/0.log" Jun 07 19:49:32.828940 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:32.828909 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:49:32.833695 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:32.833671 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8xwp_caf9750f-6777-4212-88b5-68ea78e99972/ovn-acl-logging/0.log" Jun 07 19:49:33.901774 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:33.901742 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86849f4b66-l8qsc_29efa5fd-96cc-4b05-b1df-458997a5a70e/console/0.log" Jun 07 19:49:33.964725 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:33.964697 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp"] Jun 07 19:49:33.968397 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:33.968382 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:33.970862 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:33.970835 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h49tb\"/\"kube-root-ca.crt\"" Jun 07 19:49:33.970991 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:33.970888 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h49tb\"/\"default-dockercfg-tkl64\"" Jun 07 19:49:33.971949 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:33.971930 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h49tb\"/\"openshift-service-ca.crt\"" Jun 07 19:49:33.977256 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:33.977234 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp"] Jun 07 19:49:34.079692 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.079654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-sys\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.079692 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.079690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-podres\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.079901 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.079717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-lib-modules\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.079901 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.079734 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk8xn\" (UniqueName: \"kubernetes.io/projected/2a323dc1-8f76-4273-87b5-9b5323114f43-kube-api-access-dk8xn\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.079901 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.079817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-proc\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.180782 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.180689 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-sys\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.180782 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.180728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-podres\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.180997 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.180812 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-sys\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.180997 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.180864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-lib-modules\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.180997 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.180890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8xn\" (UniqueName: \"kubernetes.io/projected/2a323dc1-8f76-4273-87b5-9b5323114f43-kube-api-access-dk8xn\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.180997 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.180902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-podres\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.180997 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.180971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-proc\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.180997 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.180991 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-lib-modules\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.181223 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.181049 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2a323dc1-8f76-4273-87b5-9b5323114f43-proc\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.189921 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.189893 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk8xn\" (UniqueName: \"kubernetes.io/projected/2a323dc1-8f76-4273-87b5-9b5323114f43-kube-api-access-dk8xn\") pod \"perf-node-gather-daemonset-trspp\" (UID: \"2a323dc1-8f76-4273-87b5-9b5323114f43\") " pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.279721 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.279693 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:34.409923 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:34.409894 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp"] Jun 07 19:49:34.411048 ip-10-0-128-213 kubenswrapper[2562]: W0607 19:49:34.411024 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2a323dc1_8f76_4273_87b5_9b5323114f43.slice/crio-4f33206799852ff31a6d63639fb915a7db6025b410efecba42d7b907e55a0ee0 WatchSource:0}: Error finding container 4f33206799852ff31a6d63639fb915a7db6025b410efecba42d7b907e55a0ee0: Status 404 returned error can't find the container with id 4f33206799852ff31a6d63639fb915a7db6025b410efecba42d7b907e55a0ee0 Jun 07 19:49:35.224943 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:35.224912 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" event={"ID":"2a323dc1-8f76-4273-87b5-9b5323114f43","Type":"ContainerStarted","Data":"218f4beea3742f47dd92f10391e61bd2e24d80728077525148c75653f3a1467c"} Jun 07 19:49:35.225364 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:35.224962 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" event={"ID":"2a323dc1-8f76-4273-87b5-9b5323114f43","Type":"ContainerStarted","Data":"4f33206799852ff31a6d63639fb915a7db6025b410efecba42d7b907e55a0ee0"} Jun 07 19:49:35.225364 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:35.225110 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:35.240055 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:35.240007 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" podStartSLOduration=2.23999367 podStartE2EDuration="2.23999367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:49:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:49:35.238453426 +0000 UTC m=+1202.913478326" watchObservedRunningTime="2026-06-07 19:49:35.23999367 +0000 UTC m=+1202.915018567" Jun 07 19:49:35.863893 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:35.863865 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-prxrw_ba6d731a-b057-4a5e-ba58-929e0abe497e/dns/0.log" Jun 07 19:49:35.882886 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:35.882860 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-prxrw_ba6d731a-b057-4a5e-ba58-929e0abe497e/kube-rbac-proxy/0.log" Jun 07 19:49:35.975078 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:35.975051 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pw76s_d4e27e88-bd37-4ece-9dc6-97e3c1bd3b63/dns-node-resolver/0.log" Jun 07 19:49:36.565553 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:36.565510 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gf466_25038978-89b5-4e4f-a340-26505aabda95/node-ca/0.log" Jun 07 19:49:37.534509 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:37.534483 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6xrv7_eaf808f2-397c-4553-802f-2d695f1ae99f/discovery/0.log" Jun 07 19:49:37.582104 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:37.582079 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d6d9c57f7-bg58x_0734007c-8c47-4447-9b7f-67d43ef3febc/kube-auth-proxy/0.log" Jun 07 19:49:38.260936 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:38.260905 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wgh4x_3ef013d1-0b73-4694-8980-d1438c33ea36/serve-healthcheck-canary/0.log" Jun 07 19:49:38.874302 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:38.874272 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5qnm_c6abe4d3-964e-4baf-9b5b-d29533e8bff3/kube-rbac-proxy/0.log" Jun 07 19:49:38.894719 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:38.894696 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5qnm_c6abe4d3-964e-4baf-9b5b-d29533e8bff3/exporter/0.log" Jun 07 19:49:38.914572 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:38.914545 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5qnm_c6abe4d3-964e-4baf-9b5b-d29533e8bff3/extractor/0.log" Jun 07 19:49:41.112660 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:41.112635 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-68c5d99799-998hf_57449cbe-7f17-4116-abde-4f5f950bfc12/nginx/0.log" Jun 07 19:49:41.162578 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:41.162552 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-4kfbm_298eaf22-ad6f-4071-9ec2-8c133301a776/manager/0.log" Jun 07 19:49:41.189093 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:41.189066 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4pzt9_8a92fe1f-d620-4b54-92b6-ceade69fa7ce/manager/0.log" Jun 07 19:49:41.212172 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:41.212144 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59c768d774-jk7l2_0eb03447-861e-435d-917c-dc6bc104e1be/manager/0.log" Jun 07 19:49:41.232762 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:41.232738 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-lzhs6_5405729f-fc0d-4ab8-af8d-7730984743b1/server/0.log" Jun 07 19:49:41.240456 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:41.240431 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h49tb/perf-node-gather-daemonset-trspp" Jun 07 19:49:41.412896 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:41.412788 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-544b9844c8-fnjxx_b0eaf737-5fa2-4705-9de5-5771272d6687/manager/0.log" Jun 07 19:49:41.431691 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:41.431666 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-544b9844c8-fnjxx_b0eaf737-5fa2-4705-9de5-5771272d6687/copy-manifests/0.log" Jun 07 19:49:43.018672 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:43.018644 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hnpws_35150e79-29fa-4768-bfa4-f6fd3bba33b3/openshift-lws-operator/0.log" Jun 07 19:49:48.666519 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:48.666480 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6xrv7_eaf808f2-397c-4553-802f-2d695f1ae99f/discovery/0.log" Jun 07 19:49:48.703262 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:48.703237 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d6d9c57f7-bg58x_0734007c-8c47-4447-9b7f-67d43ef3febc/kube-auth-proxy/0.log" Jun 07 19:49:49.840259 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:49.840228 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6xrv7_eaf808f2-397c-4553-802f-2d695f1ae99f/discovery/0.log" Jun 07 19:49:49.864428 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:49.864385 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d6d9c57f7-bg58x_0734007c-8c47-4447-9b7f-67d43ef3febc/kube-auth-proxy/0.log" Jun 07 19:49:49.920174 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:49.920142 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ltqm_ee17169b-0931-4861-97d5-84510bf566a3/kube-multus-additional-cni-plugins/0.log" Jun 07 19:49:49.940023 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:49.939999 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ltqm_ee17169b-0931-4861-97d5-84510bf566a3/egress-router-binary-copy/0.log" Jun 07 19:49:49.959340 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:49.959317 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ltqm_ee17169b-0931-4861-97d5-84510bf566a3/cni-plugins/0.log" Jun 07 19:49:49.979093 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:49.979071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ltqm_ee17169b-0931-4861-97d5-84510bf566a3/bond-cni-plugin/0.log" Jun 07 19:49:49.998237 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:49.998217 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ltqm_ee17169b-0931-4861-97d5-84510bf566a3/routeoverride-cni/0.log" Jun 07 19:49:50.017692 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:50.017667 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ltqm_ee17169b-0931-4861-97d5-84510bf566a3/whereabouts-cni-bincopy/0.log" Jun 07 19:49:50.037152 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:50.037088 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ltqm_ee17169b-0931-4861-97d5-84510bf566a3/whereabouts-cni/0.log" Jun 07 19:49:50.394758 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:50.394647 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rx555_bef8be33-a2f1-4616-93a4-e5a4f7c36a7a/kube-multus/0.log" Jun 07 19:49:50.413619 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:50.413592 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mdddh_4bd39616-fa08-4d64-975d-b9bb523de55f/network-metrics-daemon/0.log" Jun 07 19:49:50.432457 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:50.432408 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mdddh_4bd39616-fa08-4d64-975d-b9bb523de55f/kube-rbac-proxy/0.log" Jun 07 19:49:51.504953 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:51.504922 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6xrv7_eaf808f2-397c-4553-802f-2d695f1ae99f/discovery/0.log" Jun 07 19:49:51.527376 ip-10-0-128-213 kubenswrapper[2562]: I0607 19:49:51.527350 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d6d9c57f7-bg58x_0734007c-8c47-4447-9b7f-67d43ef3febc/kube-auth-proxy/0.log"