Jun 14 19:11:40.663523 ip-10-0-133-27 systemd[1]: Starting Kubernetes Kubelet... Jun 14 19:11:41.109949 ip-10-0-133-27 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 19:11:41.109949 ip-10-0-133-27 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 19:11:41.109949 ip-10-0-133-27 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 19:11:41.109949 ip-10-0-133-27 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 19:11:41.109949 ip-10-0-133-27 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 19:11:41.110630 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.110008 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 19:11:41.115862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115844 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 19:11:41.115862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115861 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115865 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115869 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115872 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115875 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115878 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115880 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115883 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115885 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115888 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115891 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115893 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115897 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115899 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115903 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115905 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115908 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115911 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115913 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115916 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 19:11:41.115926 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115919 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115921 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115924 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115927 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115929 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115932 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115935 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115938 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115940 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115943 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115947 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115952 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115955 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115958 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115961 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115964 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115966 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115969 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115971 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 19:11:41.116416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115973 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115976 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115978 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115981 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115984 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115986 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115989 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115992 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.115997 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116000 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116003 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116006 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116009 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116012 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116014 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116018 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116021 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116024 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116027 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116030 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 19:11:41.116874 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116033 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116035 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116038 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116040 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116043 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116045 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116048 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116051 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116053 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116056 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116058 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116061 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116064 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116066 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116069 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116071 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116074 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116077 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116080 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116082 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 19:11:41.117378 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116085 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116087 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116090 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116093 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116095 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116099 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116101 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116106 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116109 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116112 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116114 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116117 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116120 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116122 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116125 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116128 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116132 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116135 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116138 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116862 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 19:11:41.117856 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116869 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116872 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116875 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116878 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116881 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116884 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116886 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116889 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116892 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116894 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116897 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116901 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116904 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116907 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116909 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116912 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116914 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116917 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116920 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 19:11:41.118382 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116923 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116926 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116929 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116931 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116933 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116936 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116939 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116941 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116944 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116946 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116949 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116952 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116955 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116957 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116960 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116964 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116967 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116970 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116974 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 19:11:41.118862 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116976 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116979 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116982 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116984 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116987 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116989 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116992 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116995 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.116998 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117001 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117003 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117006 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117008 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117012 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117015 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117017 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117020 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117022 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117025 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117028 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 19:11:41.119351 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117030 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117033 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117035 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117038 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117040 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117043 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117045 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117048 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117052 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117055 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117059 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117062 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117065 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117069 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117072 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117075 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117078 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117080 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117083 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117086 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 19:11:41.119831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117089 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117091 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117094 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117096 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117099 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117102 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117105 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117108 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117110 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117113 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117115 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117118 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117120 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117123 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117125 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117128 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117130 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117133 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117136 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117138 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 19:11:41.120340 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117524 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117529 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117531 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117534 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117537 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117540 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117542 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117545 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117547 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117550 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117553 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117556 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117559 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117561 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117564 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117567 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117569 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117572 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117575 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117578 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117580 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 19:11:41.120831 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117583 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117586 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117588 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117591 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117593 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117596 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117599 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117601 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117604 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117606 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117613 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117615 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117618 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117621 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117624 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117626 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117630 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117634 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117637 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 19:11:41.121374 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117640 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117642 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117645 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117648 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117651 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117654 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117656 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117659 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117661 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117664 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117666 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117669 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117672 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117675 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117677 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117680 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117682 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117686 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117690 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 19:11:41.121847 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117693 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117696 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117698 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117701 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117705 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117709 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117711 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117715 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117718 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117721 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117723 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117726 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117728 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117731 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117733 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117736 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117738 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117741 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117744 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117747 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 19:11:41.122318 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117749 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117752 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117754 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117757 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117759 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117762 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117764 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117767 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117769 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117773 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117777 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117779 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117782 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117785 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117788 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117791 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117794 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117798 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117800 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.117803 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 19:11:41.122869 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117869 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117876 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117884 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117889 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117893 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117897 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117901 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117906 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117909 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117912 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117916 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117919 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117923 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117926 2559 flags.go:64] FLAG: --cgroup-root="" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117929 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117932 2559 flags.go:64] FLAG: --client-ca-file="" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117934 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117937 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117941 2559 flags.go:64] FLAG: --cluster-domain="" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117944 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117948 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117951 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117954 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117958 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 19:11:41.123383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117961 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117964 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117968 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117971 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117975 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117978 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117981 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117985 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117989 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117992 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117995 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.117997 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118001 2559 flags.go:64] FLAG: --enable-server="true" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118004 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118007 2559 flags.go:64] FLAG: --event-burst="100" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118010 2559 flags.go:64] FLAG: --event-qps="50" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118013 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118016 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118019 2559 flags.go:64] FLAG: --eviction-hard="" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118023 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118026 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118030 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118033 2559 flags.go:64] FLAG: --eviction-soft="" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118036 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118038 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 19:11:41.123999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118041 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118044 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118047 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118049 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118057 2559 flags.go:64] FLAG: --feature-gates="" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118061 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118064 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118067 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118071 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118074 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118077 2559 flags.go:64] FLAG: --help="false" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118081 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118084 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118087 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118090 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118094 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118097 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118100 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118103 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118106 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118108 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118112 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118115 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118117 2559 flags.go:64] FLAG: --kube-reserved="" Jun 14 19:11:41.124682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118120 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118123 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118126 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118129 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118132 2559 flags.go:64] FLAG: --lock-file="" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118135 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118138 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118141 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118147 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118150 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118164 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118167 2559 flags.go:64] FLAG: --logging-format="text" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118171 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118175 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118177 2559 flags.go:64] FLAG: --manifest-url="" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118180 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118185 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118187 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118191 2559 flags.go:64] FLAG: --max-pods="110" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118195 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118198 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118201 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118204 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118207 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118210 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 19:11:41.125460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118213 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118234 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118237 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118240 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118243 2559 flags.go:64] FLAG: --pod-cidr="" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118246 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118253 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118255 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118259 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118262 2559 flags.go:64] FLAG: --port="10250" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118264 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118268 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d4e6f84ea0eb7713" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118271 2559 flags.go:64] FLAG: --qos-reserved="" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118274 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118277 2559 flags.go:64] FLAG: --register-node="true" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118281 2559 flags.go:64] FLAG: --register-with-taints="" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118284 2559 flags.go:64] FLAG: --registry-burst="10" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118287 2559 flags.go:64] FLAG: --registry-qps="5" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118290 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118294 2559 flags.go:64] FLAG: --reserved-memory="" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118297 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118300 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118303 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118306 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118309 2559 flags.go:64] FLAG: --runonce="false" Jun 14 19:11:41.126436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118312 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118315 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118319 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118322 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118324 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118327 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118330 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118333 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118336 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118339 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118342 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118344 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118348 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118350 2559 flags.go:64] FLAG: --system-cgroups="" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118353 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118359 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118361 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118364 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118368 2559 flags.go:64] FLAG: --tls-min-version="" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118371 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118373 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118376 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118380 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118383 2559 flags.go:64] FLAG: --v="2" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118386 2559 flags.go:64] FLAG: --version="false" Jun 14 19:11:41.127061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118390 2559 flags.go:64] FLAG: --vmodule="" Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118396 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.118400 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118513 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118517 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118520 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118523 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118525 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118528 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118531 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118534 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118537 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118540 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118542 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118545 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118547 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118550 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118552 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118555 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118557 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 19:11:41.127677 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118560 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118563 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118565 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118568 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118570 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118573 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118577 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118580 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118583 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118586 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118589 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118591 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118594 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118599 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118602 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118606 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118609 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118613 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118617 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 19:11:41.128164 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118620 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118622 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118625 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118628 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118630 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118633 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118636 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118638 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118641 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118643 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118645 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118648 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118650 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118653 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118655 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118658 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118660 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118663 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118665 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118668 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 19:11:41.128686 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118671 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118673 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118676 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118679 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118681 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118684 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118688 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118690 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118693 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118695 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118698 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118700 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118703 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118705 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118708 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118710 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118713 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118715 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118718 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118720 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 19:11:41.129171 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118723 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118725 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118728 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118730 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118733 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118735 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118738 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118740 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118743 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118745 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118747 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118750 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118752 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118755 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118757 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118760 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118762 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118765 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118769 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118772 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 19:11:41.129680 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118775 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118777 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.118780 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.119536 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.127945 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.127959 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.127985 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.127990 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128046 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128051 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128055 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128058 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128061 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128063 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 19:11:41.130161 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128066 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128069 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128072 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128074 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128077 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128080 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128082 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128085 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128088 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128091 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128094 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128097 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128100 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128102 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128105 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128107 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128110 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128112 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128115 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128118 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 19:11:41.130536 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128121 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128123 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128126 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128129 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128132 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128135 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128138 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128140 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128143 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128146 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128150 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128153 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128155 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128158 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128161 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128164 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128166 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128169 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128173 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 19:11:41.131030 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128177 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128180 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128183 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128186 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128189 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128191 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128194 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128197 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128199 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128202 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128204 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128207 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128209 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128212 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128215 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128237 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128243 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128248 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128252 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128254 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 19:11:41.131579 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128257 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128260 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128262 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128265 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128267 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128270 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128272 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128275 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128277 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128280 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128283 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128285 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128288 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128290 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128295 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128297 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128300 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128302 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128305 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128307 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 19:11:41.132077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128310 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128312 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128315 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128317 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128320 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128322 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128325 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128327 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128330 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128333 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128335 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128338 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128341 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128344 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.128350 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 19:11:41.132593 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128463 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128468 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128471 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128474 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128477 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128480 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128483 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128487 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128491 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128494 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128497 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128500 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128503 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128506 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128509 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128513 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128516 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128520 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128523 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 19:11:41.132960 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128526 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128529 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128532 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128535 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128537 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128540 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128543 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128546 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128548 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128551 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128554 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128556 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128559 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128561 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128564 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128567 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128569 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128572 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128574 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 14 19:11:41.133454 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128577 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128579 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128582 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128585 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128587 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128590 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128592 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128595 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128598 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128601 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128603 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128606 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128608 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128610 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128613 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128616 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128618 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128621 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128623 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 19:11:41.133925 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128627 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128629 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128631 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128634 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128636 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128639 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128641 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128644 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128646 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128649 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128652 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128654 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128657 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128659 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128661 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128664 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128667 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128670 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128672 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128675 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 19:11:41.134403 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128677 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128680 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128683 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128686 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128689 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128692 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128695 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128697 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128700 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128703 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128705 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128708 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128710 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128713 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128715 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128718 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128721 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128723 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128726 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128729 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 19:11:41.134895 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128731 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 19:11:41.135471 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:41.128734 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 19:11:41.135471 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.128739 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 19:11:41.135471 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.128847 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 19:11:41.135471 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.132342 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 19:11:41.135471 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.133970 2559 server.go:1019] "Starting client certificate rotation" Jun 14 19:11:41.135471 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.134072 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 19:11:41.135471 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.134105 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 19:11:41.137331 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.137314 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 19:11:41.140276 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.140260 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 19:11:41.152261 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.152241 2559 log.go:25] "Validated CRI v1 runtime API" Jun 14 19:11:41.157019 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.157002 2559 log.go:25] "Validated CRI v1 image API" Jun 14 19:11:41.157823 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.157805 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 19:11:41.160170 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.160149 2559 fs.go:135] Filesystem UUIDs: map[4f147ba5-d813-41b3-b2a4-268912e01f0b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cf997535-14cd-4662-b0e3-70d5842d2e2d:/dev/nvme0n1p3] Jun 14 19:11:41.160255 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.160167 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 19:11:41.162703 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.162687 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 19:11:41.165538 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.165427 2559 manager.go:216] Machine: {Timestamp:2026-06-14 19:11:41.164029654 +0000 UTC m=+0.374960621 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098259 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a0e6b76119bc5002035db04516a47 SystemUUID:ec2a0e6b-7611-9bc5-0020-35db04516a47 BootID:daaa2b5e-7c15-46e4-aaf5-0a303c597eb4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bd:3b:66:2d:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bd:3b:66:2d:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:65:f9:94:8b:27 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 19:11:41.165538 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.165532 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 19:11:41.165634 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.165606 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 19:11:41.167234 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.167201 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 19:11:41.167363 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.167239 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-27.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 19:11:41.168455 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.168444 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 19:11:41.168494 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.168458 2559 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 19:11:41.168494 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.168466 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 19:11:41.169176 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.169166 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 19:11:41.170517 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.170507 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 19:11:41.173416 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.173405 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 14 19:11:41.173523 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.173514 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 19:11:41.173552 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.173542 2559 kubelet.go:486] "Attempting to sync node with API server" Jun 14 19:11:41.173552 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.173552 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 19:11:41.173609 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.173569 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 19:11:41.173609 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.173579 2559 kubelet.go:398] "Adding apiserver pod source" Jun 14 19:11:41.173609 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.173587 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 19:11:41.173979 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.173968 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 19:11:41.174042 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.173985 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 19:11:41.176436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.176422 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 19:11:41.178045 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178029 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 19:11:41.178082 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178062 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 19:11:41.178267 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178254 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 19:11:41.178306 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178273 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 19:11:41.178306 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178279 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 19:11:41.178306 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178284 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 19:11:41.178306 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178292 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 19:11:41.178408 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178308 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 19:11:41.178811 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178803 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 19:11:41.178843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178812 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 19:11:41.178843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178822 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 19:11:41.178843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178827 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 19:11:41.178843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178839 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 19:11:41.178944 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.178847 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 19:11:41.179484 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.179474 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 19:11:41.179484 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.179484 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 19:11:41.182938 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.182924 2559 server.go:1268] "Started kubelet" Jun 14 19:11:41.183035 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.183005 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 19:11:41.183085 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.183020 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 19:11:41.183128 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.183114 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 19:11:41.184098 ip-10-0-133-27 systemd[1]: Started Kubernetes Kubelet. Jun 14 19:11:41.184405 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.184314 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x7mxm" Jun 14 19:11:41.188071 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.188051 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 19:11:41.188297 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.188255 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-27.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 19:11:41.188580 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.188553 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 19:11:41.188580 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.188561 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 19:11:41.189794 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.189773 2559 server.go:310] "Adding debug handlers to kubelet server" Jun 14 19:11:41.191123 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.191103 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 19:11:41.191236 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.191206 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x7mxm" Jun 14 19:11:41.192216 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.191214 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-27.ec2.internal.18b90857e40bb4fe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-27.ec2.internal,UID:ip-10-0-133-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-27.ec2.internal,},FirstTimestamp:2026-06-14 19:11:41.182891262 +0000 UTC m=+0.393822209,LastTimestamp:2026-06-14 19:11:41.182891262 +0000 UTC m=+0.393822209,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-27.ec2.internal,}" Jun 14 19:11:41.194819 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.194804 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 19:11:41.194819 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.194816 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 19:11:41.194940 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.194888 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-27.ec2.internal\" not found" Jun 14 19:11:41.195333 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.195320 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 19:11:41.195444 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.195327 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 19:11:41.195444 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.195445 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 19:11:41.195613 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.195598 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 14 19:11:41.195613 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.195614 2559 reconciler.go:29] "Reconciler: start to sync state" Jun 14 19:11:41.195727 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.195713 2559 factory.go:55] Registering systemd factory Jun 14 19:11:41.195775 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.195752 2559 factory.go:223] Registration of the systemd container factory successfully Jun 14 19:11:41.195998 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.195975 2559 factory.go:153] Registering CRI-O factory Jun 14 19:11:41.195998 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.195995 2559 factory.go:223] Registration of the crio container factory successfully Jun 14 19:11:41.196073 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.196046 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 19:11:41.196073 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.196071 2559 factory.go:103] Registering Raw factory Jun 14 19:11:41.196125 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.196084 2559 manager.go:1196] Started watching for new ooms in manager Jun 14 19:11:41.196446 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.196417 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 19:11:41.196661 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.196606 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 19:11:41.196661 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.196622 2559 manager.go:349] Starting recovery of all containers Jun 14 19:11:41.207140 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.207006 2559 manager.go:354] Recovery completed Jun 14 19:11:41.211151 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.211140 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 19:11:41.213543 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.213526 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientMemory" Jun 14 19:11:41.213653 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.213551 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 19:11:41.213653 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.213561 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientPID" Jun 14 19:11:41.214117 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.214105 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 19:11:41.214117 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.214116 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 19:11:41.214209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.214132 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 14 19:11:41.214209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.214146 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 19:11:41.214808 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.214788 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientMemory" Jun 14 19:11:41.214887 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.214820 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 19:11:41.214887 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.214832 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientPID" Jun 14 19:11:41.215379 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.215366 2559 policy_none.go:49] "None policy: Start" Jun 14 19:11:41.215432 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.215382 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 19:11:41.215432 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.215393 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 19:11:41.216350 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.216340 2559 policy_none.go:47] "Start" Jun 14 19:11:41.251800 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.251784 2559 manager.go:337] "Starting Device Plugin manager" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.251820 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.251832 2559 server.go:87] "Starting device plugin registration server" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.252062 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.252073 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.252274 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.252366 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.252373 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.252939 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.252988 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-27.ec2.internal\" not found" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.258006 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.259156 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.259191 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.259209 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.259260 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 19:11:41.265242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.261369 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 19:11:41.353124 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.353037 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 19:11:41.354186 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.354164 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientMemory" Jun 14 19:11:41.354302 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.354200 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 19:11:41.354302 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.354213 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientPID" Jun 14 19:11:41.354302 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.354258 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.359606 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.359586 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-27.ec2.internal"] Jun 14 19:11:41.359671 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.359659 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 19:11:41.360504 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.360479 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientMemory" Jun 14 19:11:41.360590 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.360509 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 19:11:41.360590 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.360523 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientPID" Jun 14 19:11:41.362014 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.361998 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 19:11:41.362128 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.362114 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.362210 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.362148 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 19:11:41.362683 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.362669 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientMemory" Jun 14 19:11:41.362764 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.362700 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 19:11:41.362764 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.362714 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientPID" Jun 14 19:11:41.362764 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.362715 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientMemory" Jun 14 19:11:41.362908 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.362787 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 19:11:41.362908 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.362798 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientPID" Jun 14 19:11:41.363018 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.363004 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.363051 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.363024 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-27.ec2.internal\": node \"ip-10-0-133-27.ec2.internal\" not found" Jun 14 19:11:41.364078 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.364064 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.364121 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.364090 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 19:11:41.364738 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.364725 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientMemory" Jun 14 19:11:41.364827 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.364747 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 19:11:41.364827 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.364761 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeHasSufficientPID" Jun 14 19:11:41.375658 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.375643 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-27.ec2.internal\" not found" Jun 14 19:11:41.382821 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.382800 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-27.ec2.internal\" not found" node="ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.386111 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.386096 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-27.ec2.internal\" not found" node="ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.396909 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.396887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/542199504436da3190358cccee869c79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal\" (UID: \"542199504436da3190358cccee869c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.397003 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.396915 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542199504436da3190358cccee869c79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal\" (UID: \"542199504436da3190358cccee869c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.397003 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.396938 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8aebb6dfcd6b7ae7c40cde9de3052ff0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-27.ec2.internal\" (UID: \"8aebb6dfcd6b7ae7c40cde9de3052ff0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.475888 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.475863 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-27.ec2.internal\" not found" Jun 14 19:11:41.497805 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.497784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542199504436da3190358cccee869c79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal\" (UID: \"542199504436da3190358cccee869c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.497916 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.497815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8aebb6dfcd6b7ae7c40cde9de3052ff0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-27.ec2.internal\" (UID: \"8aebb6dfcd6b7ae7c40cde9de3052ff0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.497916 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.497838 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/542199504436da3190358cccee869c79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal\" (UID: \"542199504436da3190358cccee869c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.497916 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.497897 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8aebb6dfcd6b7ae7c40cde9de3052ff0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-27.ec2.internal\" (UID: \"8aebb6dfcd6b7ae7c40cde9de3052ff0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.498028 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.497895 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542199504436da3190358cccee869c79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal\" (UID: \"542199504436da3190358cccee869c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.498028 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.497965 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/542199504436da3190358cccee869c79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal\" (UID: \"542199504436da3190358cccee869c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.576981 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.576957 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-27.ec2.internal\" not found" Jun 14 19:11:41.677897 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.677822 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-27.ec2.internal\" not found" Jun 14 19:11:41.685985 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.685965 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.689480 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:41.689467 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-27.ec2.internal" Jun 14 19:11:41.778894 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.778863 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-27.ec2.internal\" not found" Jun 14 19:11:41.879377 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.879329 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-27.ec2.internal\" not found" Jun 14 19:11:41.979853 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:41.979770 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-27.ec2.internal\" not found" Jun 14 19:11:42.080268 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:42.080240 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-27.ec2.internal\" not found" Jun 14 19:11:42.133781 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.133755 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 19:11:42.134475 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.133928 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 19:11:42.161151 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:42.161112 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aebb6dfcd6b7ae7c40cde9de3052ff0.slice/crio-bd6f8ff1fdc63634e38a952079269e7d967ed82f7e41b16f01686d33b48088eb WatchSource:0}: Error finding container bd6f8ff1fdc63634e38a952079269e7d967ed82f7e41b16f01686d33b48088eb: Status 404 returned error can't find the container with id bd6f8ff1fdc63634e38a952079269e7d967ed82f7e41b16f01686d33b48088eb Jun 14 19:11:42.161595 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:42.161575 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542199504436da3190358cccee869c79.slice/crio-9bb053bab10f0ff6946f92b152792abe7c0e888b962da90474f148b2227cdfaa WatchSource:0}: Error finding container 9bb053bab10f0ff6946f92b152792abe7c0e888b962da90474f148b2227cdfaa: Status 404 returned error can't find the container with id 9bb053bab10f0ff6946f92b152792abe7c0e888b962da90474f148b2227cdfaa Jun 14 19:11:42.165737 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.165720 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 19:11:42.174780 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.174760 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 19:11:42.195166 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.195141 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 19:11:42.195166 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.195163 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" Jun 14 19:11:42.195301 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.195158 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 19:06:41 +0000 UTC" deadline="2027-12-19 22:10:45.978417374 +0000 UTC" Jun 14 19:11:42.195301 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.195183 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13274h59m3.783238671s" Jun 14 19:11:42.206692 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.206678 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 19:11:42.208389 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.208373 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 19:11:42.208526 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.208514 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-27.ec2.internal" Jun 14 19:11:42.217252 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.217236 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 19:11:42.224516 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.224503 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g9x4v" Jun 14 19:11:42.231903 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.231864 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g9x4v" Jun 14 19:11:42.261958 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.261912 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" event={"ID":"542199504436da3190358cccee869c79","Type":"ContainerStarted","Data":"9bb053bab10f0ff6946f92b152792abe7c0e888b962da90474f148b2227cdfaa"} Jun 14 19:11:42.262938 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.262920 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-27.ec2.internal" event={"ID":"8aebb6dfcd6b7ae7c40cde9de3052ff0","Type":"ContainerStarted","Data":"bd6f8ff1fdc63634e38a952079269e7d967ed82f7e41b16f01686d33b48088eb"} Jun 14 19:11:42.344958 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.344937 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 19:11:42.557624 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.557546 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 19:11:42.955683 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:42.955615 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 19:11:43.174907 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.174879 2559 apiserver.go:52] "Watching apiserver" Jun 14 19:11:43.179988 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.179965 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 19:11:43.180945 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.180921 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-gdfl9","openshift-image-registry/node-ca-xqqbl","openshift-multus/multus-additional-cni-plugins-k2bh7","openshift-multus/multus-dndlf","openshift-network-operator/iptables-alerter-bx4tn","openshift-ovn-kubernetes/ovnkube-node-c4hgz","kube-system/konnectivity-agent-2sbm9","kube-system/kube-apiserver-proxy-ip-10-0-133-27.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj","openshift-cluster-node-tuning-operator/tuned-r8bhv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal","openshift-multus/network-metrics-daemon-64h8v","openshift-network-diagnostics/network-check-target-scxz7","kube-system/global-pull-secret-syncer-v4tdb"] Jun 14 19:11:43.182624 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.182603 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:11:43.183814 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.183794 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:43.183902 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.183874 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:11:43.184471 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.184434 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 19:11:43.184471 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.184447 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rqnb8\"" Jun 14 19:11:43.184623 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.184531 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 19:11:43.184936 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.184913 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.186127 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.186110 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.186591 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.186571 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 19:11:43.187158 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.186890 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wk2xz\"" Jun 14 19:11:43.187158 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.186902 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 19:11:43.187158 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.186953 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 19:11:43.187158 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.186896 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 19:11:43.187404 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.187173 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 19:11:43.187677 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.187662 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 19:11:43.187938 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.187878 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bx4tn" Jun 14 19:11:43.188209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.188192 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fxdpp\"" Jun 14 19:11:43.189320 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.189252 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.190097 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.189737 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 19:11:43.190097 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.189790 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 19:11:43.190097 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.189930 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 19:11:43.190344 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.190162 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v28xn\"" Jun 14 19:11:43.190513 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.190494 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.191398 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.191369 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 19:11:43.191489 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.191440 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 19:11:43.191602 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.191578 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 19:11:43.191738 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.191722 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 19:11:43.191798 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.191741 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 19:11:43.191798 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.191763 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-28ddp\"" Jun 14 19:11:43.191898 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.191818 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gdfl9" Jun 14 19:11:43.191982 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.191966 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 19:11:43.192313 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.192293 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 19:11:43.192405 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.192391 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 19:11:43.192669 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.192649 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 19:11:43.192773 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.192649 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pf2ld\"" Jun 14 19:11:43.193086 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.193065 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqqbl" Jun 14 19:11:43.193532 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.193502 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t6kv2\"" Jun 14 19:11:43.193532 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.193515 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 19:11:43.193680 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.193610 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 19:11:43.194586 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.194568 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 19:11:43.195293 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.194570 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.195382 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.195323 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4mtx7\"" Jun 14 19:11:43.196267 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.195465 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 19:11:43.196267 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.196108 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 19:11:43.198310 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.198291 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6knxn\"" Jun 14 19:11:43.198401 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.198319 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 19:11:43.198497 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.198467 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 19:11:43.199068 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.198772 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:43.199152 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.199124 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:11:43.200482 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.200462 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:43.200570 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.200528 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:11:43.207250 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-var-lib-cni-bin\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.207357 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-hostroot\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.207357 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207290 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-multus-conf-dir\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.207357 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-cni-bin\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.207357 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1884fa89-bb6f-4754-96a2-272efd304275-konnectivity-ca\") pod \"konnectivity-agent-2sbm9\" (UID: \"1884fa89-bb6f-4754-96a2-272efd304275\") " pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:11:43.207546 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-tuned\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.207546 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-system-cni-dir\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.207546 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207411 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-multus-socket-dir-parent\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.207546 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207433 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-run-ovn\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.207546 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-lib-modules\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.207546 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207483 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-dbus\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:43.207546 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7af10ad-bbbb-444e-9689-2978956a6e58-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.207546 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-system-cni-dir\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.207843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207568 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-run-multus-certs\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.207843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-slash\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.207843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207624 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-run-openvswitch\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.207843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77965483-dfac-4037-aeac-73b6439d63f4-env-overrides\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.207843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-sys-fs\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.207843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnwbw\" (UniqueName: \"kubernetes.io/projected/58b322c9-826d-4865-b84b-88ea62be5ef7-kube-api-access-rnwbw\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.207843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207724 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7e30cee-e377-4a43-8736-212d0069b2b1-tmp-dir\") pod \"node-resolver-gdfl9\" (UID: \"e7e30cee-e377-4a43-8736-212d0069b2b1\") " pod="openshift-dns/node-resolver-gdfl9" Jun 14 19:11:43.207843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207774 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.207843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77965483-dfac-4037-aeac-73b6439d63f4-ovnkube-script-lib\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.207843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207826 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207849 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjklq\" (UniqueName: \"kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq\") pod \"network-check-target-scxz7\" (UID: \"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10\") " pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207872 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-systemd-units\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207910 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-var-lib-cni-multus\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-kubelet\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77965483-dfac-4037-aeac-73b6439d63f4-ovn-node-metrics-cert\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.207974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-registration-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-device-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-sysctl-conf\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15fe448f-38d6-497c-9685-59d72f86093e-multus-daemon-config\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208116 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1884fa89-bb6f-4754-96a2-272efd304275-agent-certs\") pod \"konnectivity-agent-2sbm9\" (UID: \"1884fa89-bb6f-4754-96a2-272efd304275\") " pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-run\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx5x9\" (UniqueName: \"kubernetes.io/projected/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-kube-api-access-vx5x9\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.208324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-cnibin\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208345 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-os-release\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-log-socket\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqh7l\" (UniqueName: \"kubernetes.io/projected/77965483-dfac-4037-aeac-73b6439d63f4-kube-api-access-bqh7l\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6267596b-a785-431e-987e-0777491ad548-serviceca\") pod \"node-ca-xqqbl\" (UID: \"6267596b-a785-431e-987e-0777491ad548\") " pod="openshift-image-registry/node-ca-xqqbl" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-systemd\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208477 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gqjk\" (UniqueName: \"kubernetes.io/projected/e7af10ad-bbbb-444e-9689-2978956a6e58-kube-api-access-8gqjk\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-os-release\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15fe448f-38d6-497c-9685-59d72f86093e-cni-binary-copy\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7af10ad-bbbb-444e-9689-2978956a6e58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-multus-cni-dir\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcjcf\" (UniqueName: \"kubernetes.io/projected/15fe448f-38d6-497c-9685-59d72f86093e-kube-api-access-kcjcf\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-node-log\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jn9l\" (UniqueName: \"kubernetes.io/projected/6267596b-a785-431e-987e-0777491ad548-kube-api-access-4jn9l\") pod \"node-ca-xqqbl\" (UID: \"6267596b-a785-431e-987e-0777491ad548\") " pod="openshift-image-registry/node-ca-xqqbl" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7e30cee-e377-4a43-8736-212d0069b2b1-hosts-file\") pod \"node-resolver-gdfl9\" (UID: \"e7e30cee-e377-4a43-8736-212d0069b2b1\") " pod="openshift-dns/node-resolver-gdfl9" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-sys\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7-host-slash\") pod \"iptables-alerter-bx4tn\" (UID: \"5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7\") " pod="openshift-network-operator/iptables-alerter-bx4tn" Jun 14 19:11:43.208981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-cni-netd\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-sysctl-d\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-kubelet-config\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r65jl\" (UniqueName: \"kubernetes.io/projected/5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7-kube-api-access-r65jl\") pod \"iptables-alerter-bx4tn\" (UID: \"5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7\") " pod="openshift-network-operator/iptables-alerter-bx4tn" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-socket-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-host\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-run-netns\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-etc-openvswitch\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.208982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6267596b-a785-431e-987e-0777491ad548-host\") pod \"node-ca-xqqbl\" (UID: \"6267596b-a785-431e-987e-0777491ad548\") " pod="openshift-image-registry/node-ca-xqqbl" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-var-lib-kubelet\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-cnibin\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-run-netns\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-etc-kubernetes\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-kubernetes\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-run-k8s-cni-cncf-io\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209193 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-tmp\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209219 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7-iptables-alerter-script\") pod \"iptables-alerter-bx4tn\" (UID: \"5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7\") " pod="openshift-network-operator/iptables-alerter-bx4tn" Jun 14 19:11:43.209776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209270 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-run-systemd\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.210650 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-var-lib-openvswitch\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.210650 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77965483-dfac-4037-aeac-73b6439d63f4-ovnkube-config\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.210650 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-modprobe-d\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.210650 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-sysconfig\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.210650 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209512 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-var-lib-kubelet\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.210650 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95rpn\" (UniqueName: \"kubernetes.io/projected/e7e30cee-e377-4a43-8736-212d0069b2b1-kube-api-access-95rpn\") pod \"node-resolver-gdfl9\" (UID: \"e7e30cee-e377-4a43-8736-212d0069b2b1\") " pod="openshift-dns/node-resolver-gdfl9" Jun 14 19:11:43.210650 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:43.210650 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.209592 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7af10ad-bbbb-444e-9689-2978956a6e58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.234940 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.234892 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 19:06:42 +0000 UTC" deadline="2028-01-19 05:03:51.080658946 +0000 UTC" Jun 14 19:11:43.235065 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.235045 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14001h52m7.84561971s" Jun 14 19:11:43.296562 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.296532 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 19:11:43.310678 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-run-netns\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.310678 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-etc-openvswitch\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.310874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310703 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6267596b-a785-431e-987e-0777491ad548-host\") pod \"node-ca-xqqbl\" (UID: \"6267596b-a785-431e-987e-0777491ad548\") " pod="openshift-image-registry/node-ca-xqqbl" Jun 14 19:11:43.310874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-var-lib-kubelet\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.310874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310739 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-run-netns\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.310874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310742 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-cnibin\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.310874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310794 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-run-netns\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.310874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310804 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6267596b-a785-431e-987e-0777491ad548-host\") pod \"node-ca-xqqbl\" (UID: \"6267596b-a785-431e-987e-0777491ad548\") " pod="openshift-image-registry/node-ca-xqqbl" Jun 14 19:11:43.310874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-run-netns\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.310874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310818 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-etc-kubernetes\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.310874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310796 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-etc-openvswitch\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.310874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-kubernetes\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.310874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310864 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-var-lib-kubelet\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310884 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-etc-kubernetes\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310901 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-cnibin\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-run-k8s-cni-cncf-io\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310936 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-kubernetes\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-tmp\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-run-k8s-cni-cncf-io\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.310983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms685\" (UniqueName: \"kubernetes.io/projected/e2f3c97e-2793-4a18-bc01-3aba6313fd48-kube-api-access-ms685\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7-iptables-alerter-script\") pod \"iptables-alerter-bx4tn\" (UID: \"5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7\") " pod="openshift-network-operator/iptables-alerter-bx4tn" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311032 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-run-systemd\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-var-lib-openvswitch\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77965483-dfac-4037-aeac-73b6439d63f4-ovnkube-config\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311085 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-modprobe-d\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311106 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-sysconfig\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311128 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-var-lib-kubelet\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95rpn\" (UniqueName: \"kubernetes.io/projected/e7e30cee-e377-4a43-8736-212d0069b2b1-kube-api-access-95rpn\") pod \"node-resolver-gdfl9\" (UID: \"e7e30cee-e377-4a43-8736-212d0069b2b1\") " pod="openshift-dns/node-resolver-gdfl9" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311194 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-modprobe-d\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.311441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311211 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-sysconfig\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311251 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7af10ad-bbbb-444e-9689-2978956a6e58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-var-lib-cni-bin\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311295 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311303 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-hostroot\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.311344 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-multus-conf-dir\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311388 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-cni-bin\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.311423 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret podName:6c0903b3-f57f-4cd6-b8eb-ee812d9af73d nodeName:}" failed. No retries permitted until 2026-06-14 19:11:43.811385739 +0000 UTC m=+3.022316691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret") pod "global-pull-secret-syncer-v4tdb" (UID: "6c0903b3-f57f-4cd6-b8eb-ee812d9af73d") : object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311429 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-cni-bin\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311451 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1884fa89-bb6f-4754-96a2-272efd304275-konnectivity-ca\") pod \"konnectivity-agent-2sbm9\" (UID: \"1884fa89-bb6f-4754-96a2-272efd304275\") " pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-tuned\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311517 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-system-cni-dir\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311541 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-multus-socket-dir-parent\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311565 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-run-ovn\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311580 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-var-lib-openvswitch\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.312180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-lib-modules\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-dbus\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312092 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7af10ad-bbbb-444e-9689-2978956a6e58-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-system-cni-dir\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-run-multus-certs\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312254 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-slash\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-system-cni-dir\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312308 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-run-openvswitch\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-slash\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312359 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-run-openvswitch\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312409 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77965483-dfac-4037-aeac-73b6439d63f4-ovnkube-config\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312415 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-multus-socket-dir-parent\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312462 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-run-ovn\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312507 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7-iptables-alerter-script\") pod \"iptables-alerter-bx4tn\" (UID: \"5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7\") " pod="openshift-network-operator/iptables-alerter-bx4tn" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312849 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-run-multus-certs\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312893 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7af10ad-bbbb-444e-9689-2978956a6e58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.313025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312974 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-var-lib-cni-bin\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313012 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77965483-dfac-4037-aeac-73b6439d63f4-env-overrides\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313021 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-dbus\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313030 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-hostroot\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.311253 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-var-lib-kubelet\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313048 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-sys-fs\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnwbw\" (UniqueName: \"kubernetes.io/projected/58b322c9-826d-4865-b84b-88ea62be5ef7-kube-api-access-rnwbw\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313087 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-multus-conf-dir\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7e30cee-e377-4a43-8736-212d0069b2b1-tmp-dir\") pod \"node-resolver-gdfl9\" (UID: \"e7e30cee-e377-4a43-8736-212d0069b2b1\") " pod="openshift-dns/node-resolver-gdfl9" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313156 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-sys-fs\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313175 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7af10ad-bbbb-444e-9689-2978956a6e58-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313181 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77965483-dfac-4037-aeac-73b6439d63f4-ovnkube-script-lib\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.312976 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-lib-modules\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313274 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7e30cee-e377-4a43-8736-212d0069b2b1-tmp-dir\") pod \"node-resolver-gdfl9\" (UID: \"e7e30cee-e377-4a43-8736-212d0069b2b1\") " pod="openshift-dns/node-resolver-gdfl9" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77965483-dfac-4037-aeac-73b6439d63f4-env-overrides\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.313745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-run-systemd\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313514 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-system-cni-dir\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjklq\" (UniqueName: \"kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq\") pod \"network-check-target-scxz7\" (UID: \"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10\") " pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313610 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313618 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-systemd-units\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313647 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-var-lib-cni-multus\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-kubelet\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313721 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-host-var-lib-cni-multus\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77965483-dfac-4037-aeac-73b6439d63f4-ovn-node-metrics-cert\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313763 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-systemd-units\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313785 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-registration-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-device-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313850 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-sysctl-conf\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313915 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15fe448f-38d6-497c-9685-59d72f86093e-multus-daemon-config\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.314507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313933 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.313984 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1884fa89-bb6f-4754-96a2-272efd304275-konnectivity-ca\") pod \"konnectivity-agent-2sbm9\" (UID: \"1884fa89-bb6f-4754-96a2-272efd304275\") " pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314012 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314061 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-kubelet\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314084 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-device-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1884fa89-bb6f-4754-96a2-272efd304275-agent-certs\") pod \"konnectivity-agent-2sbm9\" (UID: \"1884fa89-bb6f-4754-96a2-272efd304275\") " pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-run\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314174 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314174 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx5x9\" (UniqueName: \"kubernetes.io/projected/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-kube-api-access-vx5x9\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-cnibin\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314269 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-os-release\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-log-socket\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314334 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqh7l\" (UniqueName: \"kubernetes.io/projected/77965483-dfac-4037-aeac-73b6439d63f4-kube-api-access-bqh7l\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6267596b-a785-431e-987e-0777491ad548-serviceca\") pod \"node-ca-xqqbl\" (UID: \"6267596b-a785-431e-987e-0777491ad548\") " pod="openshift-image-registry/node-ca-xqqbl" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77965483-dfac-4037-aeac-73b6439d63f4-ovnkube-script-lib\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-systemd\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.315467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gqjk\" (UniqueName: \"kubernetes.io/projected/e7af10ad-bbbb-444e-9689-2978956a6e58-kube-api-access-8gqjk\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-run\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314497 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-os-release\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314517 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-registration-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314531 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15fe448f-38d6-497c-9685-59d72f86093e-cni-binary-copy\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314725 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-cnibin\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314823 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7af10ad-bbbb-444e-9689-2978956a6e58-os-release\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-log-socket\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314903 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6267596b-a785-431e-987e-0777491ad548-serviceca\") pod \"node-ca-xqqbl\" (UID: \"6267596b-a785-431e-987e-0777491ad548\") " pod="openshift-image-registry/node-ca-xqqbl" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314963 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-systemd\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.314982 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-sysctl-conf\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315058 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-os-release\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315074 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15fe448f-38d6-497c-9685-59d72f86093e-multus-daemon-config\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315117 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7af10ad-bbbb-444e-9689-2978956a6e58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315151 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-multus-cni-dir\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcjcf\" (UniqueName: \"kubernetes.io/projected/15fe448f-38d6-497c-9685-59d72f86093e-kube-api-access-kcjcf\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-node-log\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315267 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jn9l\" (UniqueName: \"kubernetes.io/projected/6267596b-a785-431e-987e-0777491ad548-kube-api-access-4jn9l\") pod \"node-ca-xqqbl\" (UID: \"6267596b-a785-431e-987e-0777491ad548\") " pod="openshift-image-registry/node-ca-xqqbl" Jun 14 19:11:43.316464 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7e30cee-e377-4a43-8736-212d0069b2b1-hosts-file\") pod \"node-resolver-gdfl9\" (UID: \"e7e30cee-e377-4a43-8736-212d0069b2b1\") " pod="openshift-dns/node-resolver-gdfl9" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-sys\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315358 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7-host-slash\") pod \"iptables-alerter-bx4tn\" (UID: \"5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7\") " pod="openshift-network-operator/iptables-alerter-bx4tn" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315389 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-cni-netd\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315415 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-sysctl-d\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-kubelet-config\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r65jl\" (UniqueName: \"kubernetes.io/projected/5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7-kube-api-access-r65jl\") pod \"iptables-alerter-bx4tn\" (UID: \"5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7\") " pod="openshift-network-operator/iptables-alerter-bx4tn" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-socket-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315525 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15fe448f-38d6-497c-9685-59d72f86093e-cni-binary-copy\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-host\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315629 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-node-log\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315724 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7af10ad-bbbb-444e-9689-2978956a6e58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315797 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15fe448f-38d6-497c-9685-59d72f86093e-multus-cni-dir\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315813 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7e30cee-e377-4a43-8736-212d0069b2b1-hosts-file\") pod \"node-resolver-gdfl9\" (UID: \"e7e30cee-e377-4a43-8736-212d0069b2b1\") " pod="openshift-dns/node-resolver-gdfl9" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315866 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-sys\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315922 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-kubelet-config\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.315926 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-sysctl-d\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.316135 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-host\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.317353 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.316252 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7-host-slash\") pod \"iptables-alerter-bx4tn\" (UID: \"5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7\") " pod="openshift-network-operator/iptables-alerter-bx4tn" Jun 14 19:11:43.318768 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.316309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77965483-dfac-4037-aeac-73b6439d63f4-host-cni-netd\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.318768 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.316874 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1884fa89-bb6f-4754-96a2-272efd304275-agent-certs\") pod \"konnectivity-agent-2sbm9\" (UID: \"1884fa89-bb6f-4754-96a2-272efd304275\") " pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:11:43.318768 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.316877 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b322c9-826d-4865-b84b-88ea62be5ef7-socket-dir\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.318768 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.318293 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-tmp\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.320768 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.320728 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77965483-dfac-4037-aeac-73b6439d63f4-ovn-node-metrics-cert\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.320918 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.320897 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-etc-tuned\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.320989 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.320928 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 19:11:43.320989 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.320946 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 19:11:43.320989 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.320958 2559 projected.go:196] Error preparing data for projected volume kube-api-access-tjklq for pod openshift-network-diagnostics/network-check-target-scxz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:43.321140 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.321001 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq podName:7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10 nodeName:}" failed. No retries permitted until 2026-06-14 19:11:43.820989384 +0000 UTC m=+3.031920319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tjklq" (UniqueName: "kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq") pod "network-check-target-scxz7" (UID: "7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:43.323252 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.322892 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95rpn\" (UniqueName: \"kubernetes.io/projected/e7e30cee-e377-4a43-8736-212d0069b2b1-kube-api-access-95rpn\") pod \"node-resolver-gdfl9\" (UID: \"e7e30cee-e377-4a43-8736-212d0069b2b1\") " pod="openshift-dns/node-resolver-gdfl9" Jun 14 19:11:43.323252 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.323184 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gqjk\" (UniqueName: \"kubernetes.io/projected/e7af10ad-bbbb-444e-9689-2978956a6e58-kube-api-access-8gqjk\") pod \"multus-additional-cni-plugins-k2bh7\" (UID: \"e7af10ad-bbbb-444e-9689-2978956a6e58\") " pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.323252 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.323245 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnwbw\" (UniqueName: \"kubernetes.io/projected/58b322c9-826d-4865-b84b-88ea62be5ef7-kube-api-access-rnwbw\") pod \"aws-ebs-csi-driver-node-jvsxj\" (UID: \"58b322c9-826d-4865-b84b-88ea62be5ef7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.324841 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.324817 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx5x9\" (UniqueName: \"kubernetes.io/projected/67298c9f-8b1d-4af4-b7e1-0e65f21efb0c-kube-api-access-vx5x9\") pod \"tuned-r8bhv\" (UID: \"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c\") " pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.325099 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.325069 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqh7l\" (UniqueName: \"kubernetes.io/projected/77965483-dfac-4037-aeac-73b6439d63f4-kube-api-access-bqh7l\") pod \"ovnkube-node-c4hgz\" (UID: \"77965483-dfac-4037-aeac-73b6439d63f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.325340 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.325319 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcjcf\" (UniqueName: \"kubernetes.io/projected/15fe448f-38d6-497c-9685-59d72f86093e-kube-api-access-kcjcf\") pod \"multus-dndlf\" (UID: \"15fe448f-38d6-497c-9685-59d72f86093e\") " pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.325801 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.325782 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jn9l\" (UniqueName: \"kubernetes.io/projected/6267596b-a785-431e-987e-0777491ad548-kube-api-access-4jn9l\") pod \"node-ca-xqqbl\" (UID: \"6267596b-a785-431e-987e-0777491ad548\") " pod="openshift-image-registry/node-ca-xqqbl" Jun 14 19:11:43.326418 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.326359 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r65jl\" (UniqueName: \"kubernetes.io/projected/5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7-kube-api-access-r65jl\") pod \"iptables-alerter-bx4tn\" (UID: \"5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7\") " pod="openshift-network-operator/iptables-alerter-bx4tn" Jun 14 19:11:43.416432 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.416399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms685\" (UniqueName: \"kubernetes.io/projected/e2f3c97e-2793-4a18-bc01-3aba6313fd48-kube-api-access-ms685\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:43.416613 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.416472 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:43.416613 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.416598 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:43.416720 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.416655 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs podName:e2f3c97e-2793-4a18-bc01-3aba6313fd48 nodeName:}" failed. No retries permitted until 2026-06-14 19:11:43.916636815 +0000 UTC m=+3.127567770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs") pod "network-metrics-daemon-64h8v" (UID: "e2f3c97e-2793-4a18-bc01-3aba6313fd48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:43.426200 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.426173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms685\" (UniqueName: \"kubernetes.io/projected/e2f3c97e-2793-4a18-bc01-3aba6313fd48-kube-api-access-ms685\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:43.495162 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.495079 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:11:43.502713 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.502691 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k2bh7" Jun 14 19:11:43.509364 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.509341 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dndlf" Jun 14 19:11:43.517040 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.517018 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bx4tn" Jun 14 19:11:43.523770 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.523746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:11:43.530474 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.530458 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" Jun 14 19:11:43.536944 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.536920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gdfl9" Jun 14 19:11:43.543470 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.543452 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqqbl" Jun 14 19:11:43.549931 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.549913 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" Jun 14 19:11:43.818490 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.818404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:43.818634 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.818567 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:43.818680 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.818650 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret podName:6c0903b3-f57f-4cd6-b8eb-ee812d9af73d nodeName:}" failed. No retries permitted until 2026-06-14 19:11:44.818635869 +0000 UTC m=+4.029566808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret") pod "global-pull-secret-syncer-v4tdb" (UID: "6c0903b3-f57f-4cd6-b8eb-ee812d9af73d") : object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:43.919232 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.919186 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:43.919390 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:43.919264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjklq\" (UniqueName: \"kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq\") pod \"network-check-target-scxz7\" (UID: \"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10\") " pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:43.919390 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.919352 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:43.919513 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.919385 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 19:11:43.919513 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.919407 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 19:11:43.919513 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.919420 2559 projected.go:196] Error preparing data for projected volume kube-api-access-tjklq for pod openshift-network-diagnostics/network-check-target-scxz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:43.919513 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.919420 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs podName:e2f3c97e-2793-4a18-bc01-3aba6313fd48 nodeName:}" failed. No retries permitted until 2026-06-14 19:11:44.91940045 +0000 UTC m=+4.130331398 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs") pod "network-metrics-daemon-64h8v" (UID: "e2f3c97e-2793-4a18-bc01-3aba6313fd48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:43.919513 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:43.919481 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq podName:7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10 nodeName:}" failed. No retries permitted until 2026-06-14 19:11:44.919464924 +0000 UTC m=+4.130395869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjklq" (UniqueName: "kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq") pod "network-check-target-scxz7" (UID: "7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:43.990203 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:43.990174 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1884fa89_bb6f_4754_96a2_272efd304275.slice/crio-39c933df1709f7a8f3596adc0379176400d20ed9a88268e71c6cdc3544252e9a WatchSource:0}: Error finding container 39c933df1709f7a8f3596adc0379176400d20ed9a88268e71c6cdc3544252e9a: Status 404 returned error can't find the container with id 39c933df1709f7a8f3596adc0379176400d20ed9a88268e71c6cdc3544252e9a Jun 14 19:11:43.991077 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:43.991051 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b322c9_826d_4865_b84b_88ea62be5ef7.slice/crio-0ffc659caee8ab743ceb81e372a0425a9d8579564fbaa7c3655f63eeb1436800 WatchSource:0}: Error finding container 0ffc659caee8ab743ceb81e372a0425a9d8579564fbaa7c3655f63eeb1436800: Status 404 returned error can't find the container with id 0ffc659caee8ab743ceb81e372a0425a9d8579564fbaa7c3655f63eeb1436800 Jun 14 19:11:43.992788 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:43.992714 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15fe448f_38d6_497c_9685_59d72f86093e.slice/crio-81af268528b04cf187914619010bc5d408a0b309989d231f6ddd18b41d2f8149 WatchSource:0}: Error finding container 81af268528b04cf187914619010bc5d408a0b309989d231f6ddd18b41d2f8149: Status 404 returned error can't find the container with id 81af268528b04cf187914619010bc5d408a0b309989d231f6ddd18b41d2f8149 Jun 14 19:11:43.995968 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:43.995946 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7af10ad_bbbb_444e_9689_2978956a6e58.slice/crio-0b920f45327a3f7ac2c486921131cf558913b46b950ecf3f932360fb866d9d98 WatchSource:0}: Error finding container 0b920f45327a3f7ac2c486921131cf558913b46b950ecf3f932360fb866d9d98: Status 404 returned error can't find the container with id 0b920f45327a3f7ac2c486921131cf558913b46b950ecf3f932360fb866d9d98 Jun 14 19:11:43.996979 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:43.996954 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77965483_dfac_4037_aeac_73b6439d63f4.slice/crio-7e29f01dee14f144f61b6cca2b1129335d97c425a2f696d07f5b355b5a69c366 WatchSource:0}: Error finding container 7e29f01dee14f144f61b6cca2b1129335d97c425a2f696d07f5b355b5a69c366: Status 404 returned error can't find the container with id 7e29f01dee14f144f61b6cca2b1129335d97c425a2f696d07f5b355b5a69c366 Jun 14 19:11:43.997823 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:43.997800 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67298c9f_8b1d_4af4_b7e1_0e65f21efb0c.slice/crio-2a7482aa0aca6b4b215543f2485ff15c3347d99811a3a48dec26bc78e1a7e96d WatchSource:0}: Error finding container 2a7482aa0aca6b4b215543f2485ff15c3347d99811a3a48dec26bc78e1a7e96d: Status 404 returned error can't find the container with id 2a7482aa0aca6b4b215543f2485ff15c3347d99811a3a48dec26bc78e1a7e96d Jun 14 19:11:43.998966 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:43.998910 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6267596b_a785_431e_987e_0777491ad548.slice/crio-487758aa2972367c79b2eb3b2942e9d8f23f34dddad707e5a3305d58f3a36318 WatchSource:0}: Error finding container 487758aa2972367c79b2eb3b2942e9d8f23f34dddad707e5a3305d58f3a36318: Status 404 returned error can't find the container with id 487758aa2972367c79b2eb3b2942e9d8f23f34dddad707e5a3305d58f3a36318 Jun 14 19:11:44.000353 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:44.000332 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb1bd94_0f1a_47ac_944a_eb0a9845dbe7.slice/crio-29c0c6e22b02087acc9ed2d63ea509dc43aaeaf85adcdbefc28ced10eb42bcef WatchSource:0}: Error finding container 29c0c6e22b02087acc9ed2d63ea509dc43aaeaf85adcdbefc28ced10eb42bcef: Status 404 returned error can't find the container with id 29c0c6e22b02087acc9ed2d63ea509dc43aaeaf85adcdbefc28ced10eb42bcef Jun 14 19:11:44.001743 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:11:44.001682 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e30cee_e377_4a43_8736_212d0069b2b1.slice/crio-5b10908e6c41c195c865446ae513ef24df6b97c2f6e4f4f1835604b9343d4dda WatchSource:0}: Error finding container 5b10908e6c41c195c865446ae513ef24df6b97c2f6e4f4f1835604b9343d4dda: Status 404 returned error can't find the container with id 5b10908e6c41c195c865446ae513ef24df6b97c2f6e4f4f1835604b9343d4dda Jun 14 19:11:44.236031 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.235881 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 19:06:42 +0000 UTC" deadline="2027-12-11 18:04:37.479768539 +0000 UTC" Jun 14 19:11:44.236394 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.236032 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13078h52m53.243740212s" Jun 14 19:11:44.267172 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.267145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dndlf" event={"ID":"15fe448f-38d6-497c-9685-59d72f86093e","Type":"ContainerStarted","Data":"81af268528b04cf187914619010bc5d408a0b309989d231f6ddd18b41d2f8149"} Jun 14 19:11:44.268397 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.268374 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" event={"ID":"58b322c9-826d-4865-b84b-88ea62be5ef7","Type":"ContainerStarted","Data":"0ffc659caee8ab743ceb81e372a0425a9d8579564fbaa7c3655f63eeb1436800"} Jun 14 19:11:44.269299 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.269272 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2sbm9" event={"ID":"1884fa89-bb6f-4754-96a2-272efd304275","Type":"ContainerStarted","Data":"39c933df1709f7a8f3596adc0379176400d20ed9a88268e71c6cdc3544252e9a"} Jun 14 19:11:44.270887 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.270864 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" event={"ID":"542199504436da3190358cccee869c79","Type":"ContainerStarted","Data":"c3ef62b86cac6aad9b1d3c5098dcb753d7ac56e48791f73caa1783fbc23eeab9"} Jun 14 19:11:44.272274 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.272253 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-27.ec2.internal" event={"ID":"8aebb6dfcd6b7ae7c40cde9de3052ff0","Type":"ContainerStarted","Data":"6d2465c467d06a9d6d5e2e3ef21d8f671cf61719786613953a7f9cd27f4d5a4d"} Jun 14 19:11:44.273119 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.273098 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gdfl9" event={"ID":"e7e30cee-e377-4a43-8736-212d0069b2b1","Type":"ContainerStarted","Data":"5b10908e6c41c195c865446ae513ef24df6b97c2f6e4f4f1835604b9343d4dda"} Jun 14 19:11:44.274304 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.274282 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bx4tn" event={"ID":"5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7","Type":"ContainerStarted","Data":"29c0c6e22b02087acc9ed2d63ea509dc43aaeaf85adcdbefc28ced10eb42bcef"} Jun 14 19:11:44.275270 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.275250 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqqbl" event={"ID":"6267596b-a785-431e-987e-0777491ad548","Type":"ContainerStarted","Data":"487758aa2972367c79b2eb3b2942e9d8f23f34dddad707e5a3305d58f3a36318"} Jun 14 19:11:44.276325 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.276305 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" event={"ID":"77965483-dfac-4037-aeac-73b6439d63f4","Type":"ContainerStarted","Data":"7e29f01dee14f144f61b6cca2b1129335d97c425a2f696d07f5b355b5a69c366"} Jun 14 19:11:44.281239 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.281172 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" event={"ID":"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c","Type":"ContainerStarted","Data":"2a7482aa0aca6b4b215543f2485ff15c3347d99811a3a48dec26bc78e1a7e96d"} Jun 14 19:11:44.284273 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.283202 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2bh7" event={"ID":"e7af10ad-bbbb-444e-9689-2978956a6e58","Type":"ContainerStarted","Data":"0b920f45327a3f7ac2c486921131cf558913b46b950ecf3f932360fb866d9d98"} Jun 14 19:11:44.293981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.293930 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-27.ec2.internal" podStartSLOduration=2.293917379 podStartE2EDuration="2.293917379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:11:44.293899372 +0000 UTC m=+3.504830329" watchObservedRunningTime="2026-06-14 19:11:44.293917379 +0000 UTC m=+3.504848335" Jun 14 19:11:44.825768 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.825166 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:44.825768 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:44.825366 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:44.825768 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:44.825427 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret podName:6c0903b3-f57f-4cd6-b8eb-ee812d9af73d nodeName:}" failed. No retries permitted until 2026-06-14 19:11:46.825408943 +0000 UTC m=+6.036339881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret") pod "global-pull-secret-syncer-v4tdb" (UID: "6c0903b3-f57f-4cd6-b8eb-ee812d9af73d") : object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:44.925741 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.925700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:44.925917 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:44.925761 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjklq\" (UniqueName: \"kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq\") pod \"network-check-target-scxz7\" (UID: \"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10\") " pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:44.925917 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:44.925909 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 19:11:44.926033 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:44.925929 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 19:11:44.926033 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:44.925942 2559 projected.go:196] Error preparing data for projected volume kube-api-access-tjklq for pod openshift-network-diagnostics/network-check-target-scxz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:44.926033 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:44.925999 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq podName:7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10 nodeName:}" failed. No retries permitted until 2026-06-14 19:11:46.925980765 +0000 UTC m=+6.136911704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjklq" (UniqueName: "kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq") pod "network-check-target-scxz7" (UID: "7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:44.926415 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:44.926396 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:44.926494 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:44.926450 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs podName:e2f3c97e-2793-4a18-bc01-3aba6313fd48 nodeName:}" failed. No retries permitted until 2026-06-14 19:11:46.926434173 +0000 UTC m=+6.137365134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs") pod "network-metrics-daemon-64h8v" (UID: "e2f3c97e-2793-4a18-bc01-3aba6313fd48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:45.259771 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:45.259700 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:45.260180 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:45.259831 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:11:45.260360 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:45.260340 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:45.260474 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:45.260452 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:11:45.260535 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:45.260522 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:45.260604 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:45.260586 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:11:45.299601 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:45.298476 2559 generic.go:356] "Generic (PLEG): container finished" podID="542199504436da3190358cccee869c79" containerID="c3ef62b86cac6aad9b1d3c5098dcb753d7ac56e48791f73caa1783fbc23eeab9" exitCode=0 Jun 14 19:11:45.299601 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:45.299403 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" event={"ID":"542199504436da3190358cccee869c79","Type":"ContainerDied","Data":"c3ef62b86cac6aad9b1d3c5098dcb753d7ac56e48791f73caa1783fbc23eeab9"} Jun 14 19:11:46.319512 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:46.319178 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" event={"ID":"542199504436da3190358cccee869c79","Type":"ContainerStarted","Data":"615ef5e4f4e9602a9de0d48b60acbe808b33edf2dc78354a9d4caa7dd352700d"} Jun 14 19:11:46.843997 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:46.843954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:46.844191 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:46.844135 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:46.844319 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:46.844195 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret podName:6c0903b3-f57f-4cd6-b8eb-ee812d9af73d nodeName:}" failed. No retries permitted until 2026-06-14 19:11:50.844178089 +0000 UTC m=+10.055109043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret") pod "global-pull-secret-syncer-v4tdb" (UID: "6c0903b3-f57f-4cd6-b8eb-ee812d9af73d") : object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:46.944401 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:46.944361 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:46.944553 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:46.944424 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjklq\" (UniqueName: \"kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq\") pod \"network-check-target-scxz7\" (UID: \"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10\") " pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:46.944610 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:46.944560 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 19:11:46.944610 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:46.944583 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 19:11:46.944610 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:46.944596 2559 projected.go:196] Error preparing data for projected volume kube-api-access-tjklq for pod openshift-network-diagnostics/network-check-target-scxz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:46.944770 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:46.944653 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq podName:7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10 nodeName:}" failed. No retries permitted until 2026-06-14 19:11:50.944635387 +0000 UTC m=+10.155566337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjklq" (UniqueName: "kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq") pod "network-check-target-scxz7" (UID: "7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:46.944770 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:46.944730 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:46.944770 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:46.944763 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs podName:e2f3c97e-2793-4a18-bc01-3aba6313fd48 nodeName:}" failed. No retries permitted until 2026-06-14 19:11:50.944752009 +0000 UTC m=+10.155682959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs") pod "network-metrics-daemon-64h8v" (UID: "e2f3c97e-2793-4a18-bc01-3aba6313fd48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:47.260837 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:47.260326 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:47.260837 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:47.260466 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:47.260837 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:47.260554 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:11:47.260837 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:47.260461 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:11:47.260837 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:47.260614 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:47.260837 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:47.260677 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:11:49.260240 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:49.259975 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:49.260240 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:49.259975 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:49.260240 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:49.260104 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:11:49.260794 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:49.260204 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:11:49.260794 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:49.260359 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:49.260794 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:49.260471 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:11:50.879153 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:50.879115 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:50.879650 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:50.879302 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:50.879650 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:50.879373 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret podName:6c0903b3-f57f-4cd6-b8eb-ee812d9af73d nodeName:}" failed. No retries permitted until 2026-06-14 19:11:58.879353485 +0000 UTC m=+18.090284422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret") pod "global-pull-secret-syncer-v4tdb" (UID: "6c0903b3-f57f-4cd6-b8eb-ee812d9af73d") : object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:50.980275 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:50.980240 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:50.980448 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:50.980293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjklq\" (UniqueName: \"kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq\") pod \"network-check-target-scxz7\" (UID: \"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10\") " pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:50.980448 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:50.980409 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:50.980448 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:50.980428 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 19:11:50.980448 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:50.980447 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 19:11:50.980645 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:50.980470 2559 projected.go:196] Error preparing data for projected volume kube-api-access-tjklq for pod openshift-network-diagnostics/network-check-target-scxz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:50.980645 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:50.980488 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs podName:e2f3c97e-2793-4a18-bc01-3aba6313fd48 nodeName:}" failed. No retries permitted until 2026-06-14 19:11:58.980468473 +0000 UTC m=+18.191399407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs") pod "network-metrics-daemon-64h8v" (UID: "e2f3c97e-2793-4a18-bc01-3aba6313fd48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:50.980645 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:50.980518 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq podName:7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10 nodeName:}" failed. No retries permitted until 2026-06-14 19:11:58.98050226 +0000 UTC m=+18.191433212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjklq" (UniqueName: "kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq") pod "network-check-target-scxz7" (UID: "7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:51.262824 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:51.262751 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:51.262972 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:51.262858 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:11:51.262972 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:51.262950 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:51.263087 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:51.263049 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:51.263136 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:51.263075 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:11:51.263191 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:51.263129 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:11:53.260180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:53.260146 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:53.260180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:53.260187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:53.260699 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:53.260146 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:53.260699 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:53.260299 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:11:53.260804 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:53.260700 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:11:53.260861 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:53.260796 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:11:55.260047 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:55.260017 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:55.260536 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:55.260017 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:55.260536 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:55.260138 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:11:55.260536 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:55.260152 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:55.260536 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:55.260264 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:11:55.260536 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:55.260332 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:11:57.259851 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:57.259820 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:57.259851 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:57.259849 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:57.260462 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:57.259816 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:57.260462 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:57.259948 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:11:57.260462 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:57.259998 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:11:57.260462 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:57.260130 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:11:58.939508 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:58.939466 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:58.939987 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:58.939638 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:58.939987 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:58.939703 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret podName:6c0903b3-f57f-4cd6-b8eb-ee812d9af73d nodeName:}" failed. No retries permitted until 2026-06-14 19:12:14.939688369 +0000 UTC m=+34.150619305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret") pod "global-pull-secret-syncer-v4tdb" (UID: "6c0903b3-f57f-4cd6-b8eb-ee812d9af73d") : object "kube-system"/"original-pull-secret" not registered Jun 14 19:11:59.040568 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:59.040498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:59.040568 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:59.040558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjklq\" (UniqueName: \"kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq\") pod \"network-check-target-scxz7\" (UID: \"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10\") " pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:59.040834 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:59.040675 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:59.040834 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:59.040686 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 19:11:59.040834 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:59.040703 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 19:11:59.040834 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:59.040715 2559 projected.go:196] Error preparing data for projected volume kube-api-access-tjklq for pod openshift-network-diagnostics/network-check-target-scxz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:59.040834 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:59.040743 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs podName:e2f3c97e-2793-4a18-bc01-3aba6313fd48 nodeName:}" failed. No retries permitted until 2026-06-14 19:12:15.04072466 +0000 UTC m=+34.251655615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs") pod "network-metrics-daemon-64h8v" (UID: "e2f3c97e-2793-4a18-bc01-3aba6313fd48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:11:59.040834 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:59.040762 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq podName:7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10 nodeName:}" failed. No retries permitted until 2026-06-14 19:12:15.0407529 +0000 UTC m=+34.251683835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjklq" (UniqueName: "kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq") pod "network-check-target-scxz7" (UID: "7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:11:59.259735 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:59.259646 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:11:59.259893 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:59.259646 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:11:59.259893 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:59.259785 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:11:59.259893 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:11:59.259844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:11:59.260094 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:59.259955 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:11:59.260094 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:11:59.260041 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:12:01.260717 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:01.260637 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:01.261146 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:01.260735 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:01.261146 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:01.260774 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:12:01.261146 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:01.260811 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:12:01.261146 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:01.260819 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:12:01.261146 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:01.260942 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:12:03.260107 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.259750 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:03.260796 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.259772 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:12:03.260796 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:03.260208 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:12:03.260796 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.259814 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:03.260796 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:03.260270 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:12:03.260796 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:03.260308 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:12:03.355007 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.354980 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:12:03.355331 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.355311 2559 generic.go:356] "Generic (PLEG): container finished" podID="77965483-dfac-4037-aeac-73b6439d63f4" containerID="4583b49d196cd335d76e05b9fadaf04194c3e0684ba7fdfd82e1cc32abf1d65c" exitCode=1 Jun 14 19:12:03.355404 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.355370 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" event={"ID":"77965483-dfac-4037-aeac-73b6439d63f4","Type":"ContainerStarted","Data":"ee3d0bc88aa43bb4c0f1d5546705c3945863c39b3bd7a971f15129a5efa646d8"} Jun 14 19:12:03.355460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.355446 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" event={"ID":"77965483-dfac-4037-aeac-73b6439d63f4","Type":"ContainerStarted","Data":"b83a0cec4d68fed3691f694dce7521cc8f4b7836ba539e8dca0f62f2b4b2f463"} Jun 14 19:12:03.355511 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.355498 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" event={"ID":"77965483-dfac-4037-aeac-73b6439d63f4","Type":"ContainerStarted","Data":"443b9dce9e99956718d0fae98d511c22eb261a0c4e04de87a496df4db20c6f9e"} Jun 14 19:12:03.355563 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.355550 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" event={"ID":"77965483-dfac-4037-aeac-73b6439d63f4","Type":"ContainerStarted","Data":"8e3f4413c9e03f36d5cf56516e04f3419e92a0e88cd0475497baf1661dea02ae"} Jun 14 19:12:03.355608 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.355597 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" event={"ID":"77965483-dfac-4037-aeac-73b6439d63f4","Type":"ContainerDied","Data":"4583b49d196cd335d76e05b9fadaf04194c3e0684ba7fdfd82e1cc32abf1d65c"} Jun 14 19:12:03.355654 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.355643 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" event={"ID":"77965483-dfac-4037-aeac-73b6439d63f4","Type":"ContainerStarted","Data":"cac3e0a37793a0a62d355e361e10eab69664bf5423476144e9487544717c57f8"} Jun 14 19:12:03.356750 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.356731 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" event={"ID":"67298c9f-8b1d-4af4-b7e1-0e65f21efb0c","Type":"ContainerStarted","Data":"6e4e021c2e77c402816964a66bf4d8092cbeaf9d19b3d9f419b576c7e0efe93c"} Jun 14 19:12:03.358189 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.358168 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7af10ad-bbbb-444e-9689-2978956a6e58" containerID="00707e0add9fbbb75a2062e825c96d6fb1616b4abf41986ef768c3adcd3c52c8" exitCode=0 Jun 14 19:12:03.358280 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.358258 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2bh7" event={"ID":"e7af10ad-bbbb-444e-9689-2978956a6e58","Type":"ContainerDied","Data":"00707e0add9fbbb75a2062e825c96d6fb1616b4abf41986ef768c3adcd3c52c8"} Jun 14 19:12:03.363003 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.362976 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dndlf" event={"ID":"15fe448f-38d6-497c-9685-59d72f86093e","Type":"ContainerStarted","Data":"3627c0c08b575c3aae9c6af85c2602a43ce41e7ad34e18e429efe72874723541"} Jun 14 19:12:03.364561 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.364538 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" event={"ID":"58b322c9-826d-4865-b84b-88ea62be5ef7","Type":"ContainerStarted","Data":"2719e911d26b52491bdd845482051b9735eba0913edf1b6356da1ddc900439ad"} Jun 14 19:12:03.365826 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.365806 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2sbm9" event={"ID":"1884fa89-bb6f-4754-96a2-272efd304275","Type":"ContainerStarted","Data":"e1ddcfceeceb6013b89df5d30a636e70f92d05d54189a64df104c909f3034a6d"} Jun 14 19:12:03.367202 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.367180 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gdfl9" event={"ID":"e7e30cee-e377-4a43-8736-212d0069b2b1","Type":"ContainerStarted","Data":"c91974f62544a2abf05b8d6bd2ad21f18cf64a209df382db3f6be254a58658a3"} Jun 14 19:12:03.368415 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.368393 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqqbl" event={"ID":"6267596b-a785-431e-987e-0777491ad548","Type":"ContainerStarted","Data":"9a6bc9fd5560455bf1bb3669561fb64322451c457ed5924fcd34f6200c43f1f5"} Jun 14 19:12:03.373116 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.373082 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r8bhv" podStartSLOduration=4.026204457 podStartE2EDuration="22.373071696s" totalImagesPullingTime="18.346867239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:03.372617716 +0000 UTC m=+22.583548671" watchObservedRunningTime="2026-06-14 19:12:03.373071696 +0000 UTC m=+22.584002652" Jun 14 19:12:03.373193 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.373161 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-27.ec2.internal" podStartSLOduration=21.37315679 podStartE2EDuration="21.37315679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:11:46.333382296 +0000 UTC m=+5.544313256" watchObservedRunningTime="2026-06-14 19:12:03.37315679 +0000 UTC m=+22.584087747" Jun 14 19:12:03.402397 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.402357 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gdfl9" podStartSLOduration=4.118572269 podStartE2EDuration="22.402343236s" totalImagesPullingTime="18.283770967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:03.38530657 +0000 UTC m=+22.596237538" watchObservedRunningTime="2026-06-14 19:12:03.402343236 +0000 UTC m=+22.613274192" Jun 14 19:12:03.426046 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.426002 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xqqbl" podStartSLOduration=4.080142089 podStartE2EDuration="22.425987418s" totalImagesPullingTime="18.345845329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:03.414193563 +0000 UTC m=+22.625124532" watchObservedRunningTime="2026-06-14 19:12:03.425987418 +0000 UTC m=+22.636918402" Jun 14 19:12:03.426427 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.426398 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2sbm9" podStartSLOduration=8.735324661 podStartE2EDuration="22.426387488s" totalImagesPullingTime="13.691062827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:03.426120945 +0000 UTC m=+22.637051884" watchObservedRunningTime="2026-06-14 19:12:03.426387488 +0000 UTC m=+22.637318445" Jun 14 19:12:03.440039 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.440000 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dndlf" podStartSLOduration=4.07949225 podStartE2EDuration="22.439988685s" totalImagesPullingTime="18.360496435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:03.439904743 +0000 UTC m=+22.650835700" watchObservedRunningTime="2026-06-14 19:12:03.439988685 +0000 UTC m=+22.650919642" Jun 14 19:12:03.491656 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.491614 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:03.560075 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.560048 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:03.611186 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.611148 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:03.653407 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:03.653388 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 19:12:04.265089 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:04.264972 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T19:12:03.653402816Z","UUID":"58efb8ee-dce1-4a5d-b913-8abec6294b83","Handler":null,"Name":"","Endpoint":""} Jun 14 19:12:04.266840 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:04.266812 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 19:12:04.267042 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:04.266856 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 19:12:04.372627 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:04.372595 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" event={"ID":"58b322c9-826d-4865-b84b-88ea62be5ef7","Type":"ContainerStarted","Data":"d0263cfaff3a345bc5e2c86f148e93635195aa0112e7dd17ab4a1f0b2bfd85a0"} Jun 14 19:12:04.374182 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:04.374132 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bx4tn" event={"ID":"5fb1bd94-0f1a-47ac-944a-eb0a9845dbe7","Type":"ContainerStarted","Data":"12afa2a1a363ede9876093e90b93dc6d6b2e41484c40afaba62cf8effc787112"} Jun 14 19:12:04.503243 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:04.503188 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:04.550059 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:04.550004 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:05.260285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:05.260216 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:05.260285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:05.260245 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:05.260468 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:05.260342 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:12:05.260468 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:05.260403 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:12:05.260575 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:05.260479 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:12:05.260575 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:05.260562 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:12:05.379668 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:05.379639 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:12:05.380131 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:05.380104 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" event={"ID":"77965483-dfac-4037-aeac-73b6439d63f4","Type":"ContainerStarted","Data":"f57dc7fc28960c77aaf47b86decad51fc167cfff3f84fa1eef2e839b399576f9"} Jun 14 19:12:05.382215 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:05.382182 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" event={"ID":"58b322c9-826d-4865-b84b-88ea62be5ef7","Type":"ContainerStarted","Data":"bd1787cb22324f9265e823fb7938de4fa8dbb4cb46696e5f9122c31a170583ef"} Jun 14 19:12:05.397285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:05.397238 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bx4tn" podStartSLOduration=6.055124526 podStartE2EDuration="24.397200494s" totalImagesPullingTime="18.342075968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:04.386589231 +0000 UTC m=+23.597520188" watchObservedRunningTime="2026-06-14 19:12:05.397200494 +0000 UTC m=+24.608131452" Jun 14 19:12:05.397623 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:05.397587 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvsxj" podStartSLOduration=4.107990998 podStartE2EDuration="24.397572267s" totalImagesPullingTime="20.289581269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:05.397166643 +0000 UTC m=+24.608097631" watchObservedRunningTime="2026-06-14 19:12:05.397572267 +0000 UTC m=+24.608503226" Jun 14 19:12:06.306908 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:06.306880 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:12:06.307525 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:06.307503 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:12:06.384560 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:06.384369 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:12:06.384966 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:06.384735 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2sbm9" Jun 14 19:12:06.440412 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:06.440380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:07.259755 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:07.259723 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:07.259901 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:07.259723 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:12:07.259901 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:07.259845 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:12:07.260009 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:07.259723 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:07.260009 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:07.259944 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:12:07.260087 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:07.260029 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:12:08.391512 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:08.391345 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:12:08.392321 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:08.391899 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" event={"ID":"77965483-dfac-4037-aeac-73b6439d63f4","Type":"ContainerStarted","Data":"2e7dbc7fd58d872c4f9fb039803532a5fc0c43b90705604695399bc16864f175"} Jun 14 19:12:08.392321 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:08.392272 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:12:08.392446 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:08.392346 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:12:08.392446 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:08.392392 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:12:08.392446 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:08.392422 2559 scope.go:117] "RemoveContainer" containerID="4583b49d196cd335d76e05b9fadaf04194c3e0684ba7fdfd82e1cc32abf1d65c" Jun 14 19:12:08.394104 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:08.394061 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7af10ad-bbbb-444e-9689-2978956a6e58" containerID="39cb77f510cc24d9c0fd8366a0088ff721e2e2239fb6b3cb244471eeed966f64" exitCode=0 Jun 14 19:12:08.394240 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:08.394101 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2bh7" event={"ID":"e7af10ad-bbbb-444e-9689-2978956a6e58","Type":"ContainerDied","Data":"39cb77f510cc24d9c0fd8366a0088ff721e2e2239fb6b3cb244471eeed966f64"} Jun 14 19:12:08.409017 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:08.408988 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:12:08.409987 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:08.409968 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:12:09.260170 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.260144 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:12:09.260341 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.260145 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:09.260341 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:09.260283 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:12:09.260341 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.260154 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:09.260474 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:09.260357 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:12:09.260474 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:09.260418 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:12:09.399830 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.399759 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:12:09.400268 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.400162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" event={"ID":"77965483-dfac-4037-aeac-73b6439d63f4","Type":"ContainerStarted","Data":"2a119a897b66751090e593733a164c9c3d22f8d397fce6a8f03c0927f2724eba"} Jun 14 19:12:09.402216 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.402191 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7af10ad-bbbb-444e-9689-2978956a6e58" containerID="153ade49f7b533a97152468a60c84afac02dee78e378975be198eb06e36f7101" exitCode=0 Jun 14 19:12:09.402330 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.402242 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2bh7" event={"ID":"e7af10ad-bbbb-444e-9689-2978956a6e58","Type":"ContainerDied","Data":"153ade49f7b533a97152468a60c84afac02dee78e378975be198eb06e36f7101"} Jun 14 19:12:09.441584 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.441522 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" podStartSLOduration=10.037692803 podStartE2EDuration="28.441502571s" totalImagesPullingTime="18.403809768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:09.423432606 +0000 UTC m=+28.634363565" watchObservedRunningTime="2026-06-14 19:12:09.441502571 +0000 UTC m=+28.652433529" Jun 14 19:12:09.905844 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.905804 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v4tdb"] Jun 14 19:12:09.906049 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.905925 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:09.906049 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:09.906037 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:12:09.906637 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.906613 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-64h8v"] Jun 14 19:12:09.906755 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.906700 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:12:09.906813 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:09.906789 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:12:09.908339 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.908316 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-scxz7"] Jun 14 19:12:09.908441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:09.908400 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:09.908511 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:09.908495 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:12:10.406585 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:10.406486 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7af10ad-bbbb-444e-9689-2978956a6e58" containerID="53021d0c1e30d32b4ade1f6861a047fff6908e92feaf787cec0a60194a58ed6b" exitCode=0 Jun 14 19:12:10.406585 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:10.406548 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2bh7" event={"ID":"e7af10ad-bbbb-444e-9689-2978956a6e58","Type":"ContainerDied","Data":"53021d0c1e30d32b4ade1f6861a047fff6908e92feaf787cec0a60194a58ed6b"} Jun 14 19:12:11.260658 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:11.260616 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:11.260839 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:11.260696 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:12:11.260839 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:11.260734 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:11.260839 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:11.260758 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:12:11.260839 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:11.260811 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:12:11.261020 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:11.260892 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:12:11.866560 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:11.866514 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:11.918316 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:11.918280 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:11.965458 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:11.965404 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:13.259717 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:13.259665 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:13.260160 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:13.259673 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:12:13.260160 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:13.259810 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:13.260160 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:13.259810 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4tdb" podUID="6c0903b3-f57f-4cd6-b8eb-ee812d9af73d" Jun 14 19:12:13.260160 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:13.259922 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:12:13.260160 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:13.260006 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scxz7" podUID="7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10" Jun 14 19:12:13.456505 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:13.456399 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:13.501680 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:13.501638 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:14.963857 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:14.963824 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:14.964304 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:14.963970 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 19:12:14.964304 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:14.964034 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret podName:6c0903b3-f57f-4cd6-b8eb-ee812d9af73d nodeName:}" failed. No retries permitted until 2026-06-14 19:12:46.964019163 +0000 UTC m=+66.174950109 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret") pod "global-pull-secret-syncer-v4tdb" (UID: "6c0903b3-f57f-4cd6-b8eb-ee812d9af73d") : object "kube-system"/"original-pull-secret" not registered Jun 14 19:12:15.064731 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.064700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:12:15.064864 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.064740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjklq\" (UniqueName: \"kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq\") pod \"network-check-target-scxz7\" (UID: \"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10\") " pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:15.064864 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:15.064847 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:12:15.064864 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:15.064858 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 19:12:15.064964 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:15.064873 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 19:12:15.064964 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:15.064882 2559 projected.go:196] Error preparing data for projected volume kube-api-access-tjklq for pod openshift-network-diagnostics/network-check-target-scxz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:12:15.064964 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:15.064911 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs podName:e2f3c97e-2793-4a18-bc01-3aba6313fd48 nodeName:}" failed. No retries permitted until 2026-06-14 19:12:47.064895458 +0000 UTC m=+66.275826392 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs") pod "network-metrics-daemon-64h8v" (UID: "e2f3c97e-2793-4a18-bc01-3aba6313fd48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 19:12:15.064964 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:15.064927 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq podName:7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10 nodeName:}" failed. No retries permitted until 2026-06-14 19:12:47.064921013 +0000 UTC m=+66.275851948 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjklq" (UniqueName: "kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq") pod "network-check-target-scxz7" (UID: "7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 19:12:15.116693 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.116668 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-27.ec2.internal" event="NodeReady" Jun 14 19:12:15.116875 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.116817 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 19:12:15.156507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.156476 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7tp75"] Jun 14 19:12:15.170535 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.170496 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x6zcm"] Jun 14 19:12:15.170812 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.170791 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.172865 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.172752 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 19:12:15.172865 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.172853 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nf5nn\"" Jun 14 19:12:15.173050 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.172998 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 19:12:15.184698 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.184679 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7tp75"] Jun 14 19:12:15.184793 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.184708 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x6zcm"] Jun 14 19:12:15.184793 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.184779 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x6zcm" Jun 14 19:12:15.186638 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.186620 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 19:12:15.186752 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.186720 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kbtq2\"" Jun 14 19:12:15.186816 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.186757 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 19:12:15.186872 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.186848 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 19:12:15.226253 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.226207 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:15.259612 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.259589 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:12:15.259775 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.259761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:15.260398 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.260379 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:15.263154 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.262402 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 19:12:15.263154 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.262424 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m44tw\"" Jun 14 19:12:15.263154 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.262468 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 19:12:15.263154 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.262699 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pxrhf\"" Jun 14 19:12:15.263154 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.262724 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 19:12:15.263154 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.262958 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 19:12:15.265907 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.265889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8596\" (UniqueName: \"kubernetes.io/projected/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-kube-api-access-z8596\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.265991 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.265917 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-config-volume\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.265991 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.265934 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.266086 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.266009 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-tmp-dir\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.327488 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.327405 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:15.366382 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.366356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-tmp-dir\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.366480 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.366389 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c63db888-e054-4e6a-b1ab-62e6ef8d530a-cert\") pod \"ingress-canary-x6zcm\" (UID: \"c63db888-e054-4e6a-b1ab-62e6ef8d530a\") " pod="openshift-ingress-canary/ingress-canary-x6zcm" Jun 14 19:12:15.366480 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.366417 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdfpx\" (UniqueName: \"kubernetes.io/projected/c63db888-e054-4e6a-b1ab-62e6ef8d530a-kube-api-access-sdfpx\") pod \"ingress-canary-x6zcm\" (UID: \"c63db888-e054-4e6a-b1ab-62e6ef8d530a\") " pod="openshift-ingress-canary/ingress-canary-x6zcm" Jun 14 19:12:15.366480 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.366457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8596\" (UniqueName: \"kubernetes.io/projected/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-kube-api-access-z8596\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.366593 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.366498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-config-volume\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.366593 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.366528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.366684 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:15.366663 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 19:12:15.366755 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:15.366743 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls podName:be35fe5c-838a-4bd4-b0b5-0c6632fcdb89 nodeName:}" failed. No retries permitted until 2026-06-14 19:12:15.866718737 +0000 UTC m=+35.077649689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls") pod "dns-default-7tp75" (UID: "be35fe5c-838a-4bd4-b0b5-0c6632fcdb89") : secret "dns-default-metrics-tls" not found Jun 14 19:12:15.366798 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.366663 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-tmp-dir\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.367075 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.367057 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-config-volume\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.375512 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.375485 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8596\" (UniqueName: \"kubernetes.io/projected/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-kube-api-access-z8596\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.420480 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.420451 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7af10ad-bbbb-444e-9689-2978956a6e58" containerID="683ea8c40ee20de8a821895ecde750786f6fd9e41235fc01db39695c98e8ab1b" exitCode=0 Jun 14 19:12:15.420582 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.420495 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2bh7" event={"ID":"e7af10ad-bbbb-444e-9689-2978956a6e58","Type":"ContainerDied","Data":"683ea8c40ee20de8a821895ecde750786f6fd9e41235fc01db39695c98e8ab1b"} Jun 14 19:12:15.467933 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.467906 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c63db888-e054-4e6a-b1ab-62e6ef8d530a-cert\") pod \"ingress-canary-x6zcm\" (UID: \"c63db888-e054-4e6a-b1ab-62e6ef8d530a\") " pod="openshift-ingress-canary/ingress-canary-x6zcm" Jun 14 19:12:15.468029 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.467967 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdfpx\" (UniqueName: \"kubernetes.io/projected/c63db888-e054-4e6a-b1ab-62e6ef8d530a-kube-api-access-sdfpx\") pod \"ingress-canary-x6zcm\" (UID: \"c63db888-e054-4e6a-b1ab-62e6ef8d530a\") " pod="openshift-ingress-canary/ingress-canary-x6zcm" Jun 14 19:12:15.470954 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.470928 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c63db888-e054-4e6a-b1ab-62e6ef8d530a-cert\") pod \"ingress-canary-x6zcm\" (UID: \"c63db888-e054-4e6a-b1ab-62e6ef8d530a\") " pod="openshift-ingress-canary/ingress-canary-x6zcm" Jun 14 19:12:15.475503 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.475478 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdfpx\" (UniqueName: \"kubernetes.io/projected/c63db888-e054-4e6a-b1ab-62e6ef8d530a-kube-api-access-sdfpx\") pod \"ingress-canary-x6zcm\" (UID: \"c63db888-e054-4e6a-b1ab-62e6ef8d530a\") " pod="openshift-ingress-canary/ingress-canary-x6zcm" Jun 14 19:12:15.492006 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.491987 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x6zcm" Jun 14 19:12:15.691974 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.691814 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x6zcm"] Jun 14 19:12:15.695253 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:12:15.695219 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63db888_e054_4e6a_b1ab_62e6ef8d530a.slice/crio-b179460d4050158c8f4f1be9fdfb0525659afc6aa916e01693ca6e46c960350b WatchSource:0}: Error finding container b179460d4050158c8f4f1be9fdfb0525659afc6aa916e01693ca6e46c960350b: Status 404 returned error can't find the container with id b179460d4050158c8f4f1be9fdfb0525659afc6aa916e01693ca6e46c960350b Jun 14 19:12:15.871392 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:15.871305 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:15.871546 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:15.871405 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 19:12:15.871546 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:15.871458 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls podName:be35fe5c-838a-4bd4-b0b5-0c6632fcdb89 nodeName:}" failed. No retries permitted until 2026-06-14 19:12:16.871445055 +0000 UTC m=+36.082375990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls") pod "dns-default-7tp75" (UID: "be35fe5c-838a-4bd4-b0b5-0c6632fcdb89") : secret "dns-default-metrics-tls" not found Jun 14 19:12:16.424319 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:16.424287 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x6zcm" event={"ID":"c63db888-e054-4e6a-b1ab-62e6ef8d530a","Type":"ContainerStarted","Data":"b179460d4050158c8f4f1be9fdfb0525659afc6aa916e01693ca6e46c960350b"} Jun 14 19:12:16.427795 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:16.427765 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7af10ad-bbbb-444e-9689-2978956a6e58" containerID="a99946e262f80b634d004dcb3f6f9fa189256dfb8397a5580b98c4cedee7c3f3" exitCode=0 Jun 14 19:12:16.427916 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:16.427835 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2bh7" event={"ID":"e7af10ad-bbbb-444e-9689-2978956a6e58","Type":"ContainerDied","Data":"a99946e262f80b634d004dcb3f6f9fa189256dfb8397a5580b98c4cedee7c3f3"} Jun 14 19:12:16.878439 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:16.878408 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:16.878749 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:16.878543 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 19:12:16.878749 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:16.878614 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls podName:be35fe5c-838a-4bd4-b0b5-0c6632fcdb89 nodeName:}" failed. No retries permitted until 2026-06-14 19:12:18.878593913 +0000 UTC m=+38.089524871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls") pod "dns-default-7tp75" (UID: "be35fe5c-838a-4bd4-b0b5-0c6632fcdb89") : secret "dns-default-metrics-tls" not found Jun 14 19:12:17.433659 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:17.433624 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2bh7" event={"ID":"e7af10ad-bbbb-444e-9689-2978956a6e58","Type":"ContainerStarted","Data":"db03f4ced4da55983604251b6dcbfd0b63f13531ae643ed7c5866c0c757a83d9"} Jun 14 19:12:17.453459 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:17.453401 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k2bh7" podStartSLOduration=7.718702413 podStartE2EDuration="36.453381421s" totalImagesPullingTime="28.734679008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:17.451892457 +0000 UTC m=+36.662823414" watchObservedRunningTime="2026-06-14 19:12:17.453381421 +0000 UTC m=+36.664312379" Jun 14 19:12:17.573342 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:17.573209 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:17.618829 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:17.618794 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:18.437443 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:18.437409 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x6zcm" event={"ID":"c63db888-e054-4e6a-b1ab-62e6ef8d530a","Type":"ContainerStarted","Data":"9dec4e94548da15426ebd8f6a103c463b1fce2a6794fb2d73c24fb5f6627e16a"} Jun 14 19:12:18.450488 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:18.450441 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x6zcm" podStartSLOduration=1.4618424110000001 podStartE2EDuration="3.450427019s" totalImagesPullingTime="1.988584608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:18.450027312 +0000 UTC m=+37.660958269" watchObservedRunningTime="2026-06-14 19:12:18.450427019 +0000 UTC m=+37.661357973" Jun 14 19:12:18.894235 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:18.894176 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:18.894394 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:18.894307 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 19:12:18.894394 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:18.894374 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls podName:be35fe5c-838a-4bd4-b0b5-0c6632fcdb89 nodeName:}" failed. No retries permitted until 2026-06-14 19:12:22.894358072 +0000 UTC m=+42.105289008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls") pod "dns-default-7tp75" (UID: "be35fe5c-838a-4bd4-b0b5-0c6632fcdb89") : secret "dns-default-metrics-tls" not found Jun 14 19:12:20.370354 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:20.370322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:20.417746 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:20.417713 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:22.923153 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:22.923115 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:22.923525 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:22.923278 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 19:12:22.923525 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:22.923342 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls podName:be35fe5c-838a-4bd4-b0b5-0c6632fcdb89 nodeName:}" failed. No retries permitted until 2026-06-14 19:12:30.923326252 +0000 UTC m=+50.134257186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls") pod "dns-default-7tp75" (UID: "be35fe5c-838a-4bd4-b0b5-0c6632fcdb89") : secret "dns-default-metrics-tls" not found Jun 14 19:12:30.977104 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:30.977069 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:30.977555 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:30.977219 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 19:12:30.977555 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:30.977297 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls podName:be35fe5c-838a-4bd4-b0b5-0c6632fcdb89 nodeName:}" failed. No retries permitted until 2026-06-14 19:12:46.977280459 +0000 UTC m=+66.188211411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls") pod "dns-default-7tp75" (UID: "be35fe5c-838a-4bd4-b0b5-0c6632fcdb89") : secret "dns-default-metrics-tls" not found Jun 14 19:12:36.548083 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.548054 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6"] Jun 14 19:12:36.551497 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.551481 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:36.554262 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.554238 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 19:12:36.554724 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.554705 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 14 19:12:36.554951 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.554934 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 19:12:36.555276 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.555261 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 19:12:36.564093 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.564073 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6"] Jun 14 19:12:36.612055 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.612033 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d51dba4-b59b-4ae0-8929-3e3cca111abe-tmp\") pod \"klusterlet-addon-workmgr-59c4f87cb7-zjvs6\" (UID: \"5d51dba4-b59b-4ae0-8929-3e3cca111abe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:36.612150 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.612113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5d51dba4-b59b-4ae0-8929-3e3cca111abe-klusterlet-config\") pod \"klusterlet-addon-workmgr-59c4f87cb7-zjvs6\" (UID: \"5d51dba4-b59b-4ae0-8929-3e3cca111abe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:36.612150 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.612137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb95l\" (UniqueName: \"kubernetes.io/projected/5d51dba4-b59b-4ae0-8929-3e3cca111abe-kube-api-access-fb95l\") pod \"klusterlet-addon-workmgr-59c4f87cb7-zjvs6\" (UID: \"5d51dba4-b59b-4ae0-8929-3e3cca111abe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:36.713237 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.713192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d51dba4-b59b-4ae0-8929-3e3cca111abe-tmp\") pod \"klusterlet-addon-workmgr-59c4f87cb7-zjvs6\" (UID: \"5d51dba4-b59b-4ae0-8929-3e3cca111abe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:36.713351 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.713333 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5d51dba4-b59b-4ae0-8929-3e3cca111abe-klusterlet-config\") pod \"klusterlet-addon-workmgr-59c4f87cb7-zjvs6\" (UID: \"5d51dba4-b59b-4ae0-8929-3e3cca111abe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:36.713390 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.713365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb95l\" (UniqueName: \"kubernetes.io/projected/5d51dba4-b59b-4ae0-8929-3e3cca111abe-kube-api-access-fb95l\") pod \"klusterlet-addon-workmgr-59c4f87cb7-zjvs6\" (UID: \"5d51dba4-b59b-4ae0-8929-3e3cca111abe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:36.713629 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.713609 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d51dba4-b59b-4ae0-8929-3e3cca111abe-tmp\") pod \"klusterlet-addon-workmgr-59c4f87cb7-zjvs6\" (UID: \"5d51dba4-b59b-4ae0-8929-3e3cca111abe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:36.717154 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.717129 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5d51dba4-b59b-4ae0-8929-3e3cca111abe-klusterlet-config\") pod \"klusterlet-addon-workmgr-59c4f87cb7-zjvs6\" (UID: \"5d51dba4-b59b-4ae0-8929-3e3cca111abe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:36.720105 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.720080 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb95l\" (UniqueName: \"kubernetes.io/projected/5d51dba4-b59b-4ae0-8929-3e3cca111abe-kube-api-access-fb95l\") pod \"klusterlet-addon-workmgr-59c4f87cb7-zjvs6\" (UID: \"5d51dba4-b59b-4ae0-8929-3e3cca111abe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:36.861323 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.861217 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:36.978533 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:36.978505 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6"] Jun 14 19:12:36.981395 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:12:36.981362 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d51dba4_b59b_4ae0_8929_3e3cca111abe.slice/crio-11cabbba982d7a3f6f309036d258a89cdda2caf36edcdb9b417973ae9f0af9e3 WatchSource:0}: Error finding container 11cabbba982d7a3f6f309036d258a89cdda2caf36edcdb9b417973ae9f0af9e3: Status 404 returned error can't find the container with id 11cabbba982d7a3f6f309036d258a89cdda2caf36edcdb9b417973ae9f0af9e3 Jun 14 19:12:37.478324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:37.478289 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" event={"ID":"5d51dba4-b59b-4ae0-8929-3e3cca111abe","Type":"ContainerStarted","Data":"11cabbba982d7a3f6f309036d258a89cdda2caf36edcdb9b417973ae9f0af9e3"} Jun 14 19:12:40.418458 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:40.418428 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4hgz" Jun 14 19:12:40.523845 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:40.523815 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:40.580136 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:40.580099 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:41.490051 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:41.490012 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" event={"ID":"5d51dba4-b59b-4ae0-8929-3e3cca111abe","Type":"ContainerStarted","Data":"afdae3bf1f57b39be9012e87fd76f775a0a8f631332767ae3875bc996977d5ac"} Jun 14 19:12:41.490529 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:41.490198 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:41.491678 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:41.491657 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:12:41.504765 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:41.504715 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" podStartSLOduration=1.889581274 podStartE2EDuration="5.50470241s" totalImagesPullingTime="3.615121136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:41.503788526 +0000 UTC m=+60.714719482" watchObservedRunningTime="2026-06-14 19:12:41.50470241 +0000 UTC m=+60.715633366" Jun 14 19:12:46.122459 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:46.122408 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:12:46.991545 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:46.991503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:12:46.991545 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:46.991547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:46.991757 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:46.991656 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 19:12:46.991757 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:46.991716 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls podName:be35fe5c-838a-4bd4-b0b5-0c6632fcdb89 nodeName:}" failed. No retries permitted until 2026-06-14 19:13:18.991698402 +0000 UTC m=+98.202629364 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls") pod "dns-default-7tp75" (UID: "be35fe5c-838a-4bd4-b0b5-0c6632fcdb89") : secret "dns-default-metrics-tls" not found Jun 14 19:12:46.993954 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:46.993932 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 19:12:47.004078 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.004052 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c0903b3-f57f-4cd6-b8eb-ee812d9af73d-original-pull-secret\") pod \"global-pull-secret-syncer-v4tdb\" (UID: \"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d\") " pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:47.082516 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.082476 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4tdb" Jun 14 19:12:47.092797 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.092765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:12:47.092891 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.092806 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjklq\" (UniqueName: \"kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq\") pod \"network-check-target-scxz7\" (UID: \"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10\") " pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:47.094924 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.094905 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 19:12:47.094999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.094919 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 19:12:47.103486 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:47.103461 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 19:12:47.103576 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:12:47.103562 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs podName:e2f3c97e-2793-4a18-bc01-3aba6313fd48 nodeName:}" failed. No retries permitted until 2026-06-14 19:13:51.103537926 +0000 UTC m=+130.314468878 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs") pod "network-metrics-daemon-64h8v" (UID: "e2f3c97e-2793-4a18-bc01-3aba6313fd48") : secret "metrics-daemon-secret" not found Jun 14 19:12:47.105075 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.105056 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 19:12:47.116551 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.116527 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjklq\" (UniqueName: \"kubernetes.io/projected/7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10-kube-api-access-tjklq\") pod \"network-check-target-scxz7\" (UID: \"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10\") " pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:47.228908 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.228878 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v4tdb"] Jun 14 19:12:47.232071 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:12:47.232042 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0903b3_f57f_4cd6_b8eb_ee812d9af73d.slice/crio-a31025189bc682998d47bc75e08affd080dbd790a541f63af8b28b9949e430bc WatchSource:0}: Error finding container a31025189bc682998d47bc75e08affd080dbd790a541f63af8b28b9949e430bc: Status 404 returned error can't find the container with id a31025189bc682998d47bc75e08affd080dbd790a541f63af8b28b9949e430bc Jun 14 19:12:47.379858 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.379825 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pxrhf\"" Jun 14 19:12:47.388290 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.388272 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:47.508655 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.508623 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v4tdb" event={"ID":"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d","Type":"ContainerStarted","Data":"a31025189bc682998d47bc75e08affd080dbd790a541f63af8b28b9949e430bc"} Jun 14 19:12:47.543598 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:47.543569 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-scxz7"] Jun 14 19:12:47.546822 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:12:47.546800 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc942b7_3ff0_44f0_aa12_dfa30aaa3c10.slice/crio-99fea1dcbe6358fe9ab5949ee38784e6dac03284c1cbdeba426f8278564ae31e WatchSource:0}: Error finding container 99fea1dcbe6358fe9ab5949ee38784e6dac03284c1cbdeba426f8278564ae31e: Status 404 returned error can't find the container with id 99fea1dcbe6358fe9ab5949ee38784e6dac03284c1cbdeba426f8278564ae31e Jun 14 19:12:48.513785 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:48.513746 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-scxz7" event={"ID":"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10","Type":"ContainerStarted","Data":"99fea1dcbe6358fe9ab5949ee38784e6dac03284c1cbdeba426f8278564ae31e"} Jun 14 19:12:52.526349 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:52.526306 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-scxz7" event={"ID":"7bc942b7-3ff0-44f0-aa12-dfa30aaa3c10","Type":"ContainerStarted","Data":"a242bf8aca11d1cc302e5b796662cc94e58b84e5dc039c2f30c596c5163cd94a"} Jun 14 19:12:52.526820 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:52.526407 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:12:52.527620 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:52.527600 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v4tdb" event={"ID":"6c0903b3-f57f-4cd6-b8eb-ee812d9af73d","Type":"ContainerStarted","Data":"80f174c1bec5b8746d06e7c0c73331d155c3d52cdaf44589e897884ee95d747c"} Jun 14 19:12:52.540264 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:52.540200 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-scxz7" podStartSLOduration=67.121576833 podStartE2EDuration="1m11.540188211s" totalImagesPullingTime="4.418611378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:52.539279427 +0000 UTC m=+71.750210401" watchObservedRunningTime="2026-06-14 19:12:52.540188211 +0000 UTC m=+71.751119168" Jun 14 19:12:52.550883 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:12:52.550841 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v4tdb" podStartSLOduration=66.817647532 podStartE2EDuration="1m11.550828672s" totalImagesPullingTime="4.73318114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:12:52.550753604 +0000 UTC m=+71.761684562" watchObservedRunningTime="2026-06-14 19:12:52.550828672 +0000 UTC m=+71.761759629" Jun 14 19:13:19.003938 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:13:19.003902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:13:19.004370 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:13:19.004035 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 19:13:19.004370 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:13:19.004087 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls podName:be35fe5c-838a-4bd4-b0b5-0c6632fcdb89 nodeName:}" failed. No retries permitted until 2026-06-14 19:14:23.004072836 +0000 UTC m=+162.215003772 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls") pod "dns-default-7tp75" (UID: "be35fe5c-838a-4bd4-b0b5-0c6632fcdb89") : secret "dns-default-metrics-tls" not found Jun 14 19:13:23.532979 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:13:23.532945 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-scxz7" Jun 14 19:13:51.104598 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:13:51.104561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:13:51.104991 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:13:51.104685 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 19:13:51.104991 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:13:51.104763 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs podName:e2f3c97e-2793-4a18-bc01-3aba6313fd48 nodeName:}" failed. No retries permitted until 2026-06-14 19:15:53.104748883 +0000 UTC m=+252.315679819 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs") pod "network-metrics-daemon-64h8v" (UID: "e2f3c97e-2793-4a18-bc01-3aba6313fd48") : secret "metrics-daemon-secret" not found Jun 14 19:14:18.179941 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:18.179896 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7tp75" podUID="be35fe5c-838a-4bd4-b0b5-0c6632fcdb89" Jun 14 19:14:18.272281 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:18.272248 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-64h8v" podUID="e2f3c97e-2793-4a18-bc01-3aba6313fd48" Jun 14 19:14:18.727569 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:18.727536 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7tp75" Jun 14 19:14:23.005478 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:23.005436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:14:23.005864 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:23.005547 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 19:14:23.005864 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:23.005608 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls podName:be35fe5c-838a-4bd4-b0b5-0c6632fcdb89 nodeName:}" failed. No retries permitted until 2026-06-14 19:16:25.005593682 +0000 UTC m=+284.216524618 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls") pod "dns-default-7tp75" (UID: "be35fe5c-838a-4bd4-b0b5-0c6632fcdb89") : secret "dns-default-metrics-tls" not found Jun 14 19:14:25.731620 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:25.731547 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:32.259859 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:32.259827 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:14:40.779768 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:40.779742 2559 generic.go:356] "Generic (PLEG): container finished" podID="5d51dba4-b59b-4ae0-8929-3e3cca111abe" containerID="afdae3bf1f57b39be9012e87fd76f775a0a8f631332767ae3875bc996977d5ac" exitCode=1 Jun 14 19:14:40.780065 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:40.779781 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" event={"ID":"5d51dba4-b59b-4ae0-8929-3e3cca111abe","Type":"ContainerDied","Data":"afdae3bf1f57b39be9012e87fd76f775a0a8f631332767ae3875bc996977d5ac"} Jun 14 19:14:40.780103 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:40.780075 2559 scope.go:117] "RemoveContainer" containerID="afdae3bf1f57b39be9012e87fd76f775a0a8f631332767ae3875bc996977d5ac" Jun 14 19:14:41.490929 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:41.490888 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:14:41.786658 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:41.786577 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" event={"ID":"5d51dba4-b59b-4ae0-8929-3e3cca111abe","Type":"ContainerStarted","Data":"19dc37bcb45d5bdbee74c6e1957cb5fe4e8c455355a2dcb8248020c2cc157ada"} Jun 14 19:14:41.787028 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:41.786774 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:14:41.787386 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:41.787370 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c4f87cb7-zjvs6" Jun 14 19:14:45.847893 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.847857 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-k7f4j"] Jun 14 19:14:45.849690 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.849672 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-k7f4j" Jun 14 19:14:45.851722 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.851698 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 14 19:14:45.852314 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.852291 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 14 19:14:45.852421 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.852324 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kk5hx\"" Jun 14 19:14:45.858704 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.858682 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-k7f4j"] Jun 14 19:14:45.947841 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.947811 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-wqmmr"] Jun 14 19:14:45.950031 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.950015 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:45.951672 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.951647 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8657cd5fd4-w8k9z"] Jun 14 19:14:45.952366 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.952342 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 14 19:14:45.952748 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.952729 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 14 19:14:45.952839 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.952780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 14 19:14:45.953260 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.953241 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mtdrw\"" Jun 14 19:14:45.953373 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.953364 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c6bb87bbb-9vgv7"] Jun 14 19:14:45.953555 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.953539 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:45.953668 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.953627 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 14 19:14:45.955204 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.955182 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqdx8\" (UniqueName: \"kubernetes.io/projected/daab4eab-3bcd-4720-aa03-f0dd757f3df0-kube-api-access-zqdx8\") pod \"volume-data-source-validator-bd4ccd799-k7f4j\" (UID: \"daab4eab-3bcd-4720-aa03-f0dd757f3df0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-k7f4j" Jun 14 19:14:45.955889 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.955872 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:45.956389 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.956367 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 19:14:45.956559 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.956546 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 19:14:45.956619 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.956588 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 19:14:45.956682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.956670 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qht7\"" Jun 14 19:14:45.959675 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.959653 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 19:14:45.959942 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.959922 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 14 19:14:45.960097 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.960082 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 19:14:45.960217 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.960197 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ggxbt\"" Jun 14 19:14:45.960302 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.960123 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 14 19:14:45.960355 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.960184 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 14 19:14:45.960421 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.960132 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 14 19:14:45.960506 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.960487 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 14 19:14:45.964284 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.964268 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-wqmmr"] Jun 14 19:14:45.964651 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.964632 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 19:14:45.970144 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.970124 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8657cd5fd4-w8k9z"] Jun 14 19:14:45.979416 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:45.979397 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c6bb87bbb-9vgv7"] Jun 14 19:14:46.056445 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056416 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10e1ea21-cf8b-4548-9b19-0d161456ddbb-trusted-ca\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.056445 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-certificates\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.056641 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnsg5\" (UniqueName: \"kubernetes.io/projected/10e1ea21-cf8b-4548-9b19-0d161456ddbb-kube-api-access-xnsg5\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.056641 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056506 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg55q\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-kube-api-access-tg55q\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.056641 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-installation-pull-secrets\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.056641 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056594 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.056641 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-ca-trust-extracted\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.056835 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056661 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdx8\" (UniqueName: \"kubernetes.io/projected/daab4eab-3bcd-4720-aa03-f0dd757f3df0-kube-api-access-zqdx8\") pod \"volume-data-source-validator-bd4ccd799-k7f4j\" (UID: \"daab4eab-3bcd-4720-aa03-f0dd757f3df0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-k7f4j" Jun 14 19:14:46.056835 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.056835 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-image-registry-private-configuration\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.056835 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-default-certificate\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.056835 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-stats-auth\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.056835 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10e1ea21-cf8b-4548-9b19-0d161456ddbb-serving-cert\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.056835 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056801 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-trusted-ca\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.056835 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-bound-sa-token\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.057074 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10e1ea21-cf8b-4548-9b19-0d161456ddbb-config\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.057074 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5778\" (UniqueName: \"kubernetes.io/projected/98c783af-19e4-40a7-921f-d95eec7f1eeb-kube-api-access-x5778\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.057074 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.056949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.068964 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.068933 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqdx8\" (UniqueName: \"kubernetes.io/projected/daab4eab-3bcd-4720-aa03-f0dd757f3df0-kube-api-access-zqdx8\") pod \"volume-data-source-validator-bd4ccd799-k7f4j\" (UID: \"daab4eab-3bcd-4720-aa03-f0dd757f3df0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-k7f4j" Jun 14 19:14:46.091616 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.091585 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:46.144371 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.144298 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:46.157401 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-bound-sa-token\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.157487 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157408 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10e1ea21-cf8b-4548-9b19-0d161456ddbb-config\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.157487 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5778\" (UniqueName: \"kubernetes.io/projected/98c783af-19e4-40a7-921f-d95eec7f1eeb-kube-api-access-x5778\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.157487 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157449 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.157590 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.157520 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 19:14:46.157590 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10e1ea21-cf8b-4548-9b19-0d161456ddbb-trusted-ca\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.157590 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.157576 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs podName:98c783af-19e4-40a7-921f-d95eec7f1eeb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:46.657557083 +0000 UTC m=+185.868488039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs") pod "router-default-5c6bb87bbb-9vgv7" (UID: "98c783af-19e4-40a7-921f-d95eec7f1eeb") : secret "router-metrics-certs-default" not found Jun 14 19:14:46.157728 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157602 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-certificates\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.157728 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157643 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnsg5\" (UniqueName: \"kubernetes.io/projected/10e1ea21-cf8b-4548-9b19-0d161456ddbb-kube-api-access-xnsg5\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.157728 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157673 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg55q\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-kube-api-access-tg55q\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.157728 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157703 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-installation-pull-secrets\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.157728 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.158004 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157766 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-ca-trust-extracted\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.158004 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157819 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.158004 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-image-registry-private-configuration\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.158004 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-default-certificate\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.158004 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-stats-auth\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.158004 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10e1ea21-cf8b-4548-9b19-0d161456ddbb-serving-cert\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.158004 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.157978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-trusted-ca\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.158384 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.158219 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10e1ea21-cf8b-4548-9b19-0d161456ddbb-config\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.158384 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.158305 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-certificates\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.158490 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.158454 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10e1ea21-cf8b-4548-9b19-0d161456ddbb-trusted-ca\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.158490 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.158464 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-ca-trust-extracted\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.158593 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.158496 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle podName:98c783af-19e4-40a7-921f-d95eec7f1eeb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:46.658478736 +0000 UTC m=+185.869409685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle") pod "router-default-5c6bb87bbb-9vgv7" (UID: "98c783af-19e4-40a7-921f-d95eec7f1eeb") : configmap references non-existent config key: service-ca.crt Jun 14 19:14:46.158593 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.158556 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-k7f4j" Jun 14 19:14:46.158593 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.158564 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 19:14:46.158593 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.158578 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8657cd5fd4-w8k9z: secret "image-registry-tls" not found Jun 14 19:14:46.158803 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.158631 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls podName:6b1eba42-38ff-4268-ba3c-2b002bab7bc1 nodeName:}" failed. No retries permitted until 2026-06-14 19:14:46.658614825 +0000 UTC m=+185.869545761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls") pod "image-registry-8657cd5fd4-w8k9z" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1") : secret "image-registry-tls" not found Jun 14 19:14:46.158890 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.158868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-trusted-ca\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.160547 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.160504 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-installation-pull-secrets\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.160658 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.160543 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-image-registry-private-configuration\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.160861 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.160838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-default-certificate\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.161381 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.161033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10e1ea21-cf8b-4548-9b19-0d161456ddbb-serving-cert\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.161381 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.161098 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-stats-auth\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.168298 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.167674 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5778\" (UniqueName: \"kubernetes.io/projected/98c783af-19e4-40a7-921f-d95eec7f1eeb-kube-api-access-x5778\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.168706 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.168687 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnsg5\" (UniqueName: \"kubernetes.io/projected/10e1ea21-cf8b-4548-9b19-0d161456ddbb-kube-api-access-xnsg5\") pod \"console-operator-5dbbb5d744-wqmmr\" (UID: \"10e1ea21-cf8b-4548-9b19-0d161456ddbb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.168803 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.168744 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-bound-sa-token\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.168918 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.168897 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg55q\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-kube-api-access-tg55q\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.261771 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.261741 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:46.279505 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.279475 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-k7f4j"] Jun 14 19:14:46.282367 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:14:46.282335 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaab4eab_3bcd_4720_aa03_f0dd757f3df0.slice/crio-a5a100549c4bb33e0e347418df0fc946a53fe60c5170673dc868e57dc3d2ea08 WatchSource:0}: Error finding container a5a100549c4bb33e0e347418df0fc946a53fe60c5170673dc868e57dc3d2ea08: Status 404 returned error can't find the container with id a5a100549c4bb33e0e347418df0fc946a53fe60c5170673dc868e57dc3d2ea08 Jun 14 19:14:46.380867 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.380838 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-wqmmr"] Jun 14 19:14:46.383802 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:14:46.383776 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e1ea21_cf8b_4548_9b19_0d161456ddbb.slice/crio-36764bf9446547fb8f529e65712f5faa4ce98e113da6a81c5b2eaf1afb802425 WatchSource:0}: Error finding container 36764bf9446547fb8f529e65712f5faa4ce98e113da6a81c5b2eaf1afb802425: Status 404 returned error can't find the container with id 36764bf9446547fb8f529e65712f5faa4ce98e113da6a81c5b2eaf1afb802425 Jun 14 19:14:46.661175 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.661139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:46.661373 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.661190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.661373 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.661255 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:46.661373 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.661302 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 19:14:46.661373 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.661323 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8657cd5fd4-w8k9z: secret "image-registry-tls" not found Jun 14 19:14:46.661373 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.661354 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 19:14:46.661529 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.661380 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle podName:98c783af-19e4-40a7-921f-d95eec7f1eeb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:47.661362173 +0000 UTC m=+186.872293123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle") pod "router-default-5c6bb87bbb-9vgv7" (UID: "98c783af-19e4-40a7-921f-d95eec7f1eeb") : configmap references non-existent config key: service-ca.crt Jun 14 19:14:46.661529 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.661402 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls podName:6b1eba42-38ff-4268-ba3c-2b002bab7bc1 nodeName:}" failed. No retries permitted until 2026-06-14 19:14:47.661393527 +0000 UTC m=+186.872324466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls") pod "image-registry-8657cd5fd4-w8k9z" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1") : secret "image-registry-tls" not found Jun 14 19:14:46.661529 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:46.661412 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs podName:98c783af-19e4-40a7-921f-d95eec7f1eeb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:47.661407365 +0000 UTC m=+186.872338305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs") pod "router-default-5c6bb87bbb-9vgv7" (UID: "98c783af-19e4-40a7-921f-d95eec7f1eeb") : secret "router-metrics-certs-default" not found Jun 14 19:14:46.799241 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.799203 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" event={"ID":"10e1ea21-cf8b-4548-9b19-0d161456ddbb","Type":"ContainerStarted","Data":"36764bf9446547fb8f529e65712f5faa4ce98e113da6a81c5b2eaf1afb802425"} Jun 14 19:14:46.800242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:46.800196 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-k7f4j" event={"ID":"daab4eab-3bcd-4720-aa03-f0dd757f3df0","Type":"ContainerStarted","Data":"a5a100549c4bb33e0e347418df0fc946a53fe60c5170673dc868e57dc3d2ea08"} Jun 14 19:14:47.669619 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:47.669587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:47.670066 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:47.669641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:47.670066 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:47.669678 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:47.670066 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:47.669772 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 19:14:47.670066 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:47.669791 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 19:14:47.670066 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:47.669807 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8657cd5fd4-w8k9z: secret "image-registry-tls" not found Jun 14 19:14:47.670066 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:47.669818 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle podName:98c783af-19e4-40a7-921f-d95eec7f1eeb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:49.669804331 +0000 UTC m=+188.880735277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle") pod "router-default-5c6bb87bbb-9vgv7" (UID: "98c783af-19e4-40a7-921f-d95eec7f1eeb") : configmap references non-existent config key: service-ca.crt Jun 14 19:14:47.670066 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:47.669834 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs podName:98c783af-19e4-40a7-921f-d95eec7f1eeb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:49.669827924 +0000 UTC m=+188.880758859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs") pod "router-default-5c6bb87bbb-9vgv7" (UID: "98c783af-19e4-40a7-921f-d95eec7f1eeb") : secret "router-metrics-certs-default" not found Jun 14 19:14:47.670066 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:47.669847 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls podName:6b1eba42-38ff-4268-ba3c-2b002bab7bc1 nodeName:}" failed. No retries permitted until 2026-06-14 19:14:49.669840321 +0000 UTC m=+188.880771257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls") pod "image-registry-8657cd5fd4-w8k9z" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1") : secret "image-registry-tls" not found Jun 14 19:14:47.806401 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:47.806368 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-k7f4j" event={"ID":"daab4eab-3bcd-4720-aa03-f0dd757f3df0","Type":"ContainerStarted","Data":"1a6487910a027a9576d0836997474e493b6e4f3564ead43a54c90a6f838e8e42"} Jun 14 19:14:47.820945 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:47.820895 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-k7f4j" podStartSLOduration=1.431957854 podStartE2EDuration="2.820874396s" totalImagesPullingTime="1.388916542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:14:47.819347562 +0000 UTC m=+187.030278518" watchObservedRunningTime="2026-06-14 19:14:47.820874396 +0000 UTC m=+187.031805355" Jun 14 19:14:47.888864 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:47.888831 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:48.811083 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:48.811056 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/0.log" Jun 14 19:14:48.811638 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:48.811093 2559 generic.go:356] "Generic (PLEG): container finished" podID="10e1ea21-cf8b-4548-9b19-0d161456ddbb" containerID="8362fc793af56608d2f3587aadebb90c6765b2754dd58732cf2e24998fe53d38" exitCode=255 Jun 14 19:14:48.811638 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:48.811128 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" event={"ID":"10e1ea21-cf8b-4548-9b19-0d161456ddbb","Type":"ContainerDied","Data":"8362fc793af56608d2f3587aadebb90c6765b2754dd58732cf2e24998fe53d38"} Jun 14 19:14:48.811638 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:48.811424 2559 scope.go:117] "RemoveContainer" containerID="8362fc793af56608d2f3587aadebb90c6765b2754dd58732cf2e24998fe53d38" Jun 14 19:14:49.684275 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:49.684239 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:49.684442 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:49.684288 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:49.684442 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:49.684382 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 19:14:49.684442 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:49.684383 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:49.684590 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:49.684436 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs podName:98c783af-19e4-40a7-921f-d95eec7f1eeb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:53.684423029 +0000 UTC m=+192.895353969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs") pod "router-default-5c6bb87bbb-9vgv7" (UID: "98c783af-19e4-40a7-921f-d95eec7f1eeb") : secret "router-metrics-certs-default" not found Jun 14 19:14:49.684590 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:49.684384 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 19:14:49.684590 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:49.684468 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8657cd5fd4-w8k9z: secret "image-registry-tls" not found Jun 14 19:14:49.684590 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:49.684469 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle podName:98c783af-19e4-40a7-921f-d95eec7f1eeb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:53.68445413 +0000 UTC m=+192.895385065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle") pod "router-default-5c6bb87bbb-9vgv7" (UID: "98c783af-19e4-40a7-921f-d95eec7f1eeb") : configmap references non-existent config key: service-ca.crt Jun 14 19:14:49.684590 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:49.684507 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls podName:6b1eba42-38ff-4268-ba3c-2b002bab7bc1 nodeName:}" failed. No retries permitted until 2026-06-14 19:14:53.684495811 +0000 UTC m=+192.895426773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls") pod "image-registry-8657cd5fd4-w8k9z" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1") : secret "image-registry-tls" not found Jun 14 19:14:49.815378 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:49.815355 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:14:49.815712 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:49.815702 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/0.log" Jun 14 19:14:49.815752 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:49.815735 2559 generic.go:356] "Generic (PLEG): container finished" podID="10e1ea21-cf8b-4548-9b19-0d161456ddbb" containerID="46b1b2ac658ec6fbaebc07a737f4102cf84483eb1da4fbe2e0f5f6a590ea180c" exitCode=255 Jun 14 19:14:49.815790 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:49.815773 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" event={"ID":"10e1ea21-cf8b-4548-9b19-0d161456ddbb","Type":"ContainerDied","Data":"46b1b2ac658ec6fbaebc07a737f4102cf84483eb1da4fbe2e0f5f6a590ea180c"} Jun 14 19:14:49.815843 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:49.815831 2559 scope.go:117] "RemoveContainer" containerID="8362fc793af56608d2f3587aadebb90c6765b2754dd58732cf2e24998fe53d38" Jun 14 19:14:49.816060 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:49.816024 2559 scope.go:117] "RemoveContainer" containerID="46b1b2ac658ec6fbaebc07a737f4102cf84483eb1da4fbe2e0f5f6a590ea180c" Jun 14 19:14:49.816236 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:49.816202 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-wqmmr_openshift-console-operator(10e1ea21-cf8b-4548-9b19-0d161456ddbb)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" podUID="10e1ea21-cf8b-4548-9b19-0d161456ddbb" Jun 14 19:14:50.807131 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.807094 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xntcd"] Jun 14 19:14:50.810188 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.810164 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.812220 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.812200 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 19:14:50.812310 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.812241 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qjxw9\"" Jun 14 19:14:50.812365 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.812306 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 19:14:50.812526 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.812510 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 19:14:50.812603 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.812517 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 19:14:50.820137 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.820119 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:14:50.820462 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.820140 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xntcd"] Jun 14 19:14:50.820517 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.820503 2559 scope.go:117] "RemoveContainer" containerID="46b1b2ac658ec6fbaebc07a737f4102cf84483eb1da4fbe2e0f5f6a590ea180c" Jun 14 19:14:50.820654 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:50.820636 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-wqmmr_openshift-console-operator(10e1ea21-cf8b-4548-9b19-0d161456ddbb)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" podUID="10e1ea21-cf8b-4548-9b19-0d161456ddbb" Jun 14 19:14:50.838897 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.838868 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:50.890710 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.890687 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:50.893816 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.893798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5x5v\" (UniqueName: \"kubernetes.io/projected/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-api-access-v5x5v\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.894025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.894004 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-data-volume\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.894111 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.894049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-crio-socket\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.894111 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.894093 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.894211 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.894112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.994685 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.994655 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.994685 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.994686 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.994892 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.994715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5x5v\" (UniqueName: \"kubernetes.io/projected/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-api-access-v5x5v\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.994892 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:50.994779 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 19:14:50.994892 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.994831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-data-volume\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.994892 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:50.994852 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm podName:c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:51.49483238 +0000 UTC m=+190.705763330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xntcd" (UID: "c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb") : configmap "kube-rbac-proxy" not found Jun 14 19:14:50.994892 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:50.994791 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 19:14:50.995121 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.994904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-crio-socket\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.995121 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:50.994940 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls podName:c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:51.494919672 +0000 UTC m=+190.705850632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xntcd" (UID: "c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb") : secret "insights-runtime-extractor-tls" not found Jun 14 19:14:50.995121 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.994993 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-crio-socket\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:50.995121 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:50.995071 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-data-volume\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:51.001701 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:51.001681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5x5v\" (UniqueName: \"kubernetes.io/projected/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-api-access-v5x5v\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:51.104505 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:51.104443 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:51.204144 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:51.204115 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:51.307192 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:51.307169 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:51.359276 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:51.359185 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:51.498008 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:51.497981 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:51.498008 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:51.498010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:51.498153 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:51.498105 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 19:14:51.498153 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:51.498116 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 19:14:51.498213 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:51.498170 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm podName:c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:52.498154694 +0000 UTC m=+191.709085629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xntcd" (UID: "c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb") : configmap "kube-rbac-proxy" not found Jun 14 19:14:51.498213 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:51.498185 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls podName:c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:52.498178973 +0000 UTC m=+191.709109908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xntcd" (UID: "c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb") : secret "insights-runtime-extractor-tls" not found Jun 14 19:14:51.754980 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:51.754895 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:52.032019 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:52.031946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:52.135700 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:52.135670 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:52.508157 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:52.508119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:52.508157 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:52.508162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:52.508454 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:52.508286 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 19:14:52.508454 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:52.508360 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm podName:c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:54.508341017 +0000 UTC m=+193.719271976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xntcd" (UID: "c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb") : configmap "kube-rbac-proxy" not found Jun 14 19:14:52.508454 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:52.508287 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 19:14:52.508454 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:52.508414 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls podName:c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:54.508403535 +0000 UTC m=+193.719334475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xntcd" (UID: "c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb") : secret "insights-runtime-extractor-tls" not found Jun 14 19:14:52.988276 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:52.988250 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gdfl9_e7e30cee-e377-4a43-8736-212d0069b2b1/dns-node-resolver/0.log" Jun 14 19:14:53.271247 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:53.271148 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:53.321909 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:53.321875 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:53.663564 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:53.663531 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:53.715692 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:53.715663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:53.717794 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:53.717773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:53.717897 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:53.717859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:14:53.717956 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:53.717915 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle podName:98c783af-19e4-40a7-921f-d95eec7f1eeb nodeName:}" failed. No retries permitted until 2026-06-14 19:15:01.717899205 +0000 UTC m=+200.928830140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle") pod "router-default-5c6bb87bbb-9vgv7" (UID: "98c783af-19e4-40a7-921f-d95eec7f1eeb") : configmap references non-existent config key: service-ca.crt Jun 14 19:14:53.717956 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:53.717935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:14:53.718062 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:53.717982 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 19:14:53.718062 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:53.718019 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 19:14:53.718062 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:53.718030 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs podName:98c783af-19e4-40a7-921f-d95eec7f1eeb nodeName:}" failed. No retries permitted until 2026-06-14 19:15:01.718015026 +0000 UTC m=+200.928945974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs") pod "router-default-5c6bb87bbb-9vgv7" (UID: "98c783af-19e4-40a7-921f-d95eec7f1eeb") : secret "router-metrics-certs-default" not found Jun 14 19:14:53.718062 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:53.718030 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8657cd5fd4-w8k9z: secret "image-registry-tls" not found Jun 14 19:14:53.718219 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:53.718071 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls podName:6b1eba42-38ff-4268-ba3c-2b002bab7bc1 nodeName:}" failed. No retries permitted until 2026-06-14 19:15:01.718061511 +0000 UTC m=+200.928992461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls") pod "image-registry-8657cd5fd4-w8k9z" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1") : secret "image-registry-tls" not found Jun 14 19:14:53.985306 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:53.985219 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqqbl_6267596b-a785-431e-987e-0777491ad548/node-ca/0.log" Jun 14 19:14:54.483268 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:54.483218 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:54.524758 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:54.524731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:54.524840 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:54.524772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:54.524840 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:54.524834 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 19:14:54.524911 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:54.524884 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm podName:c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:58.524871468 +0000 UTC m=+197.735802402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xntcd" (UID: "c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb") : configmap "kube-rbac-proxy" not found Jun 14 19:14:54.524911 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:54.524902 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 19:14:54.524983 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:54.524942 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls podName:c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb nodeName:}" failed. No retries permitted until 2026-06-14 19:14:58.524928359 +0000 UTC m=+197.735859293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xntcd" (UID: "c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb") : secret "insights-runtime-extractor-tls" not found Jun 14 19:14:54.788530 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:54.788457 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x6zcm_c63db888-e054-4e6a-b1ab-62e6ef8d530a/serve-healthcheck-canary/0.log" Jun 14 19:14:55.741717 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:55.741683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:55.842242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:55.842196 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:55.943403 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:55.943368 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:56.043428 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:56.043354 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:56.261914 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:56.261886 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:56.261914 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:56.261922 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:14:56.262176 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:56.262165 2559 scope.go:117] "RemoveContainer" containerID="46b1b2ac658ec6fbaebc07a737f4102cf84483eb1da4fbe2e0f5f6a590ea180c" Jun 14 19:14:56.262319 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:56.262303 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-wqmmr_openshift-console-operator(10e1ea21-cf8b-4548-9b19-0d161456ddbb)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" podUID="10e1ea21-cf8b-4548-9b19-0d161456ddbb" Jun 14 19:14:56.824122 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:56.824091 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:57.066009 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:57.065971 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:57.426637 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:57.426606 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:57.626003 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:57.625973 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:57.825434 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:57.825406 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:58.218029 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:58.217951 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:58.559253 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:58.559204 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:58.559419 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:58.559264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:14:58.559419 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:58.559332 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 19:14:58.559419 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:58.559395 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 19:14:58.559545 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:58.559400 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm podName:c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb nodeName:}" failed. No retries permitted until 2026-06-14 19:15:06.55938329 +0000 UTC m=+205.770314230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xntcd" (UID: "c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb") : configmap "kube-rbac-proxy" not found Jun 14 19:14:58.559545 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:14:58.559480 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls podName:c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb nodeName:}" failed. No retries permitted until 2026-06-14 19:15:06.559466038 +0000 UTC m=+205.770396979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xntcd" (UID: "c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb") : secret "insights-runtime-extractor-tls" not found Jun 14 19:14:58.618512 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:58.618478 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:59.221037 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:59.221008 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:59.619861 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:59.619828 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:59.720345 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:59.720320 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:14:59.821396 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:14:59.821366 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:00.017538 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:00.017466 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:00.229434 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:00.229408 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:00.421411 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:00.421385 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:01.299344 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:01.299310 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:01.619138 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:01.619052 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:01.784679 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:01.784648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:15:01.784856 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:01.784693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:15:01.784930 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:01.784857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:15:01.785049 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:15:01.785028 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle podName:98c783af-19e4-40a7-921f-d95eec7f1eeb nodeName:}" failed. No retries permitted until 2026-06-14 19:15:17.785006385 +0000 UTC m=+216.995937320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle") pod "router-default-5c6bb87bbb-9vgv7" (UID: "98c783af-19e4-40a7-921f-d95eec7f1eeb") : configmap references non-existent config key: service-ca.crt Jun 14 19:15:01.787034 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:01.787010 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls\") pod \"image-registry-8657cd5fd4-w8k9z\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:15:01.787134 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:01.787074 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98c783af-19e4-40a7-921f-d95eec7f1eeb-metrics-certs\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:15:01.819991 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:01.819965 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:01.868908 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:01.868878 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:15:01.991977 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:01.991941 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8657cd5fd4-w8k9z"] Jun 14 19:15:01.995508 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:15:01.995481 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1eba42_38ff_4268_ba3c_2b002bab7bc1.slice/crio-93b4c4910852d337f92cd3a7cbc72bbc175c2b12b70266e129e46e1ecf24f5c2 WatchSource:0}: Error finding container 93b4c4910852d337f92cd3a7cbc72bbc175c2b12b70266e129e46e1ecf24f5c2: Status 404 returned error can't find the container with id 93b4c4910852d337f92cd3a7cbc72bbc175c2b12b70266e129e46e1ecf24f5c2 Jun 14 19:15:02.017991 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:02.017969 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:02.209919 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:02.209833 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:02.259506 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:02.259476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:02.415890 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:02.415858 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:02.854504 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:02.854470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" event={"ID":"6b1eba42-38ff-4268-ba3c-2b002bab7bc1","Type":"ContainerStarted","Data":"c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b"} Jun 14 19:15:02.854667 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:02.854523 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" event={"ID":"6b1eba42-38ff-4268-ba3c-2b002bab7bc1","Type":"ContainerStarted","Data":"93b4c4910852d337f92cd3a7cbc72bbc175c2b12b70266e129e46e1ecf24f5c2"} Jun 14 19:15:02.854667 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:02.854580 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:15:02.873412 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:02.873367 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" podStartSLOduration=17.873353247 podStartE2EDuration="17.873353247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:15:02.873154206 +0000 UTC m=+202.084085164" watchObservedRunningTime="2026-06-14 19:15:02.873353247 +0000 UTC m=+202.084284215" Jun 14 19:15:03.218077 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:03.217993 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:03.617311 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:03.617282 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:03.820571 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:03.820540 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:03.920692 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:03.920609 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:04.418514 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:04.418484 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:05.017322 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:05.017293 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:05.221789 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:05.221757 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:05.617596 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:05.617566 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:05.818445 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:05.818413 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:06.021666 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:06.021576 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:06.417567 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:06.417531 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:06.623171 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:06.623131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:15:06.623171 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:06.623171 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:15:06.623703 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:06.623676 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:15:06.625527 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:06.625496 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xntcd\" (UID: \"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb\") " pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:15:06.719449 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:06.719365 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xntcd" Jun 14 19:15:06.843401 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:06.843369 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xntcd"] Jun 14 19:15:06.847650 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:15:06.847619 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a5bf3b_1bcc_4318_b697_dd1f7c2e91eb.slice/crio-a7330bb0e111f8c75d9eb87caa48e545f99e6d389a5576b93864ef98272c7846 WatchSource:0}: Error finding container a7330bb0e111f8c75d9eb87caa48e545f99e6d389a5576b93864ef98272c7846: Status 404 returned error can't find the container with id a7330bb0e111f8c75d9eb87caa48e545f99e6d389a5576b93864ef98272c7846 Jun 14 19:15:06.867281 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:06.867244 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xntcd" event={"ID":"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb","Type":"ContainerStarted","Data":"a7330bb0e111f8c75d9eb87caa48e545f99e6d389a5576b93864ef98272c7846"} Jun 14 19:15:08.260040 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:08.260014 2559 scope.go:117] "RemoveContainer" containerID="46b1b2ac658ec6fbaebc07a737f4102cf84483eb1da4fbe2e0f5f6a590ea180c" Jun 14 19:15:10.874275 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:10.874242 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:10.881202 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:10.881180 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:15:10.881344 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:10.881291 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" event={"ID":"10e1ea21-cf8b-4548-9b19-0d161456ddbb","Type":"ContainerStarted","Data":"1769b639cd6c2990f9b003d17f39afe945d0730512e525d7a3e41ea4cd945acc"} Jun 14 19:15:10.881593 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:10.881577 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:15:10.883171 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:10.883148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xntcd" event={"ID":"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb","Type":"ContainerStarted","Data":"f23219ef7f162539ee16b43e590393860e2223f4079d34afb8922b4e51428495"} Jun 14 19:15:10.883294 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:10.883188 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xntcd" event={"ID":"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb","Type":"ContainerStarted","Data":"5900a182efcbd2c71a7b4c0c2ff8f6ada9add93a783c5a3fa4a3e35e2e137c8c"} Jun 14 19:15:10.886275 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:10.886258 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" Jun 14 19:15:10.896159 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:10.896120 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-wqmmr" podStartSLOduration=24.059957292 podStartE2EDuration="25.896107627s" totalImagesPullingTime="1.836150335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:15:10.895126728 +0000 UTC m=+210.106057684" watchObservedRunningTime="2026-06-14 19:15:10.896107627 +0000 UTC m=+210.107038583" Jun 14 19:15:10.975216 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:10.975138 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:11.025764 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:11.025734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:11.168821 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:11.168782 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:11.349474 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:11.349438 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:11.559865 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:11.559832 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:11.627482 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:11.627412 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8657cd5fd4-w8k9z"] Jun 14 19:15:11.729670 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:11.729637 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:11.829069 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:11.829034 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:12.761731 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:12.761658 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:12.811884 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:12.811860 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:12.890676 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:12.890650 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xntcd" event={"ID":"c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb","Type":"ContainerStarted","Data":"1783d03d3ce40a81b01082687e9ab1498b728f628dd31fed070da4bcdfb71724"} Jun 14 19:15:12.907689 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:12.907645 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xntcd" podStartSLOduration=17.43750552 podStartE2EDuration="22.907631443s" totalImagesPullingTime="5.470125923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:14:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:15:12.906107984 +0000 UTC m=+212.117038962" watchObservedRunningTime="2026-06-14 19:15:12.907631443 +0000 UTC m=+212.118562400" Jun 14 19:15:12.956828 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:12.956802 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:13.054677 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:13.054653 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:17.236862 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:17.236823 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:17.335048 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:17.335016 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:17.810881 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:17.810847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:15:17.811469 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:17.811450 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98c783af-19e4-40a7-921f-d95eec7f1eeb-service-ca-bundle\") pod \"router-default-5c6bb87bbb-9vgv7\" (UID: \"98c783af-19e4-40a7-921f-d95eec7f1eeb\") " pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:15:18.074345 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:18.074274 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:15:18.197366 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:18.197336 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c6bb87bbb-9vgv7"] Jun 14 19:15:18.200603 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:15:18.200576 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c783af_19e4_40a7_921f_d95eec7f1eeb.slice/crio-e9c9ab7d4ee976adc3f891f8e045880e6108f22ff40a022332d4f4708333692e WatchSource:0}: Error finding container e9c9ab7d4ee976adc3f891f8e045880e6108f22ff40a022332d4f4708333692e: Status 404 returned error can't find the container with id e9c9ab7d4ee976adc3f891f8e045880e6108f22ff40a022332d4f4708333692e Jun 14 19:15:18.913767 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:18.913735 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" event={"ID":"98c783af-19e4-40a7-921f-d95eec7f1eeb","Type":"ContainerStarted","Data":"b6ae658fbd2cc849c8237579a2c815145d71218eea3d1f6958024d1399afc445"} Jun 14 19:15:18.914154 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:18.913782 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" event={"ID":"98c783af-19e4-40a7-921f-d95eec7f1eeb","Type":"ContainerStarted","Data":"e9c9ab7d4ee976adc3f891f8e045880e6108f22ff40a022332d4f4708333692e"} Jun 14 19:15:18.931655 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:18.931601 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" podStartSLOduration=33.931562587 podStartE2EDuration="33.931562587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:15:18.930764312 +0000 UTC m=+218.141695268" watchObservedRunningTime="2026-06-14 19:15:18.931562587 +0000 UTC m=+218.142493546" Jun 14 19:15:19.074394 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:19.074366 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:15:19.076943 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:19.076923 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:15:19.917577 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:19.917549 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:15:19.918740 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:19.918719 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c6bb87bbb-9vgv7" Jun 14 19:15:20.184580 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.184509 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-679695c9d4-54jjn"] Jun 14 19:15:20.187622 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.187607 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.189788 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.189763 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 19:15:20.189788 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.189785 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 19:15:20.190126 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.189764 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mxpzn\"" Jun 14 19:15:20.190126 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.189763 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 19:15:20.190268 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.190251 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 19:15:20.190346 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.190325 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 19:15:20.190406 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.190347 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 19:15:20.190406 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.190380 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 19:15:20.195241 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.195203 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679695c9d4-54jjn"] Jun 14 19:15:20.333046 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.333016 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-service-ca\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.333191 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.333073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbtpd\" (UniqueName: \"kubernetes.io/projected/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-kube-api-access-sbtpd\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.333191 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.333135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-serving-cert\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.333191 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.333162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-config\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.333380 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.333273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-oauth-serving-cert\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.333380 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.333314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-oauth-config\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.414630 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.414597 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:20.433660 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.433637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-service-ca\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.433729 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.433685 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbtpd\" (UniqueName: \"kubernetes.io/projected/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-kube-api-access-sbtpd\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.433729 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.433713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-serving-cert\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.433789 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.433744 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-config\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.433789 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.433763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-oauth-serving-cert\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.433789 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.433781 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-oauth-config\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.434470 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.434452 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-config\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.434542 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.434455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-service-ca\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.434542 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.434494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-oauth-serving-cert\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.436807 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.436754 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-oauth-config\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.436807 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.436757 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-serving-cert\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.442285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.442265 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbtpd\" (UniqueName: \"kubernetes.io/projected/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-kube-api-access-sbtpd\") pod \"console-679695c9d4-54jjn\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.497077 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.497056 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:20.512477 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.512437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:20.614797 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.614771 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:20.618773 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.618747 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679695c9d4-54jjn"] Jun 14 19:15:20.621198 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.621179 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s"] Jun 14 19:15:20.622842 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:15:20.622807 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9e3e6b_eb98_44b3_9d0a_9410263cb540.slice/crio-0580fea2e28390e9d308ef999d69cef56c99c1626e068136c0da00fcaeec1082 WatchSource:0}: Error finding container 0580fea2e28390e9d308ef999d69cef56c99c1626e068136c0da00fcaeec1082: Status 404 returned error can't find the container with id 0580fea2e28390e9d308ef999d69cef56c99c1626e068136c0da00fcaeec1082 Jun 14 19:15:20.625434 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.625417 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s" Jun 14 19:15:20.627243 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.627201 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 14 19:15:20.627336 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.627268 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-q5gcw\"" Jun 14 19:15:20.633066 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.633045 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s"] Jun 14 19:15:20.675251 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.675178 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:20.735987 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.735918 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3ee73e71-e8aa-46ae-96fc-d87a768fbe57-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-8n46s\" (UID: \"3ee73e71-e8aa-46ae-96fc-d87a768fbe57\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s" Jun 14 19:15:20.836328 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.836303 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3ee73e71-e8aa-46ae-96fc-d87a768fbe57-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-8n46s\" (UID: \"3ee73e71-e8aa-46ae-96fc-d87a768fbe57\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s" Jun 14 19:15:20.838643 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.838620 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3ee73e71-e8aa-46ae-96fc-d87a768fbe57-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-8n46s\" (UID: \"3ee73e71-e8aa-46ae-96fc-d87a768fbe57\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s" Jun 14 19:15:20.921469 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.921438 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679695c9d4-54jjn" event={"ID":"1a9e3e6b-eb98-44b3-9d0a-9410263cb540","Type":"ContainerStarted","Data":"0580fea2e28390e9d308ef999d69cef56c99c1626e068136c0da00fcaeec1082"} Jun 14 19:15:20.936840 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:20.936819 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s" Jun 14 19:15:21.054599 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:21.054572 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s"] Jun 14 19:15:21.058330 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:15:21.058299 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee73e71_e8aa_46ae_96fc_d87a768fbe57.slice/crio-c2eb8b511af66b89c107bb689f9fc2fb8aba5dd1a2f11f89b05e16aa29f25f5d WatchSource:0}: Error finding container c2eb8b511af66b89c107bb689f9fc2fb8aba5dd1a2f11f89b05e16aa29f25f5d: Status 404 returned error can't find the container with id c2eb8b511af66b89c107bb689f9fc2fb8aba5dd1a2f11f89b05e16aa29f25f5d Jun 14 19:15:21.634747 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:21.634709 2559 patch_prober.go:28] interesting pod/image-registry-8657cd5fd4-w8k9z container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 19:15:21.634915 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:21.634776 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" podUID="6b1eba42-38ff-4268-ba3c-2b002bab7bc1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 19:15:21.928189 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:21.927971 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s" event={"ID":"3ee73e71-e8aa-46ae-96fc-d87a768fbe57","Type":"ContainerStarted","Data":"c2eb8b511af66b89c107bb689f9fc2fb8aba5dd1a2f11f89b05e16aa29f25f5d"} Jun 14 19:15:22.933421 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:22.933381 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s" event={"ID":"3ee73e71-e8aa-46ae-96fc-d87a768fbe57","Type":"ContainerStarted","Data":"96e3deb0cca7482cc661711d5932e4d1a3c42f3fbd466d8fb6f33fac57ffab34"} Jun 14 19:15:22.933848 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:22.933619 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s" Jun 14 19:15:22.938899 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:22.938873 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s" Jun 14 19:15:22.948587 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:22.948527 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8n46s" podStartSLOduration=1.812312345 podStartE2EDuration="2.948513851s" totalImagesPullingTime="1.136201506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:15:22.947175489 +0000 UTC m=+222.158106448" watchObservedRunningTime="2026-06-14 19:15:22.948513851 +0000 UTC m=+222.159444808" Jun 14 19:15:23.644410 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.644386 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:23.677356 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.677325 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj"] Jun 14 19:15:23.680284 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.680256 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:23.682138 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.682116 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 14 19:15:23.682766 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.682747 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 19:15:23.682851 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.682773 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 19:15:23.682851 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.682799 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lsd6g\"" Jun 14 19:15:23.682851 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.682776 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 14 19:15:23.683010 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.682876 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 19:15:23.688340 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.688287 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj"] Jun 14 19:15:23.704770 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.704749 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:23.861443 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.861361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fe6b319-afa3-4400-b290-f85609148a54-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:23.861443 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.861402 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x2cc\" (UniqueName: \"kubernetes.io/projected/1fe6b319-afa3-4400-b290-f85609148a54-kube-api-access-6x2cc\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:23.861626 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.861472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe6b319-afa3-4400-b290-f85609148a54-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:23.861626 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.861494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1fe6b319-afa3-4400-b290-f85609148a54-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:23.938574 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.938540 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679695c9d4-54jjn" event={"ID":"1a9e3e6b-eb98-44b3-9d0a-9410263cb540","Type":"ContainerStarted","Data":"0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518"} Jun 14 19:15:23.952923 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.952879 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-679695c9d4-54jjn" podStartSLOduration=0.984472242 podStartE2EDuration="3.95286536s" totalImagesPullingTime="2.968393118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:15:23.952369147 +0000 UTC m=+223.163300104" watchObservedRunningTime="2026-06-14 19:15:23.95286536 +0000 UTC m=+223.163796316" Jun 14 19:15:23.962039 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.962016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fe6b319-afa3-4400-b290-f85609148a54-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:23.962134 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.962043 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x2cc\" (UniqueName: \"kubernetes.io/projected/1fe6b319-afa3-4400-b290-f85609148a54-kube-api-access-6x2cc\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:23.962134 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.962080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe6b319-afa3-4400-b290-f85609148a54-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:23.962134 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.962097 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1fe6b319-afa3-4400-b290-f85609148a54-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:23.962236 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:15:23.962195 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 14 19:15:23.962282 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:15:23.962269 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fe6b319-afa3-4400-b290-f85609148a54-prometheus-operator-tls podName:1fe6b319-afa3-4400-b290-f85609148a54 nodeName:}" failed. No retries permitted until 2026-06-14 19:15:24.462251485 +0000 UTC m=+223.673182435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1fe6b319-afa3-4400-b290-f85609148a54-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-qq6qj" (UID: "1fe6b319-afa3-4400-b290-f85609148a54") : secret "prometheus-operator-tls" not found Jun 14 19:15:23.962673 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.962655 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fe6b319-afa3-4400-b290-f85609148a54-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:23.964398 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.964379 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1fe6b319-afa3-4400-b290-f85609148a54-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:23.969518 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:23.969492 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x2cc\" (UniqueName: \"kubernetes.io/projected/1fe6b319-afa3-4400-b290-f85609148a54-kube-api-access-6x2cc\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:24.212169 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.212092 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:24.373475 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.373443 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:24.376333 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.376309 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cd858cb59-4p4c2"] Jun 14 19:15:24.380546 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.380525 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.390236 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.390192 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd858cb59-4p4c2"] Jun 14 19:15:24.392955 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.392278 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 19:15:24.426173 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.426151 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:24.466602 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.466533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe6b319-afa3-4400-b290-f85609148a54-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:24.468845 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.468820 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe6b319-afa3-4400-b290-f85609148a54-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-qq6qj\" (UID: \"1fe6b319-afa3-4400-b290-f85609148a54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:24.567540 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.567511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-oauth-config\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.567540 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.567543 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-oauth-serving-cert\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.567721 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.567560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-serving-cert\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.567721 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.567603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfc6h\" (UniqueName: \"kubernetes.io/projected/f92a6e81-06de-4ad1-9ade-44cabf511b38-kube-api-access-zfc6h\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.567721 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.567633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-service-ca\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.567721 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.567652 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-config\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.567721 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.567678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-trusted-ca-bundle\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.590532 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.590510 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" Jun 14 19:15:24.668945 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.668668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-oauth-config\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.668945 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.668714 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-oauth-serving-cert\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.668945 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.668747 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-serving-cert\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.668945 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.668814 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfc6h\" (UniqueName: \"kubernetes.io/projected/f92a6e81-06de-4ad1-9ade-44cabf511b38-kube-api-access-zfc6h\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.669209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.668960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-service-ca\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.669209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.669000 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-config\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.669209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.669057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-trusted-ca-bundle\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.669644 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.669620 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-oauth-serving-cert\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.670087 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.669849 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-trusted-ca-bundle\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.670275 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.670253 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-config\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.670375 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.670311 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-service-ca\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.672118 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.672096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-serving-cert\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.672215 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.672168 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-oauth-config\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.677129 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.677106 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfc6h\" (UniqueName: \"kubernetes.io/projected/f92a6e81-06de-4ad1-9ade-44cabf511b38-kube-api-access-zfc6h\") pod \"console-5cd858cb59-4p4c2\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.691794 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.691770 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:24.713277 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.713251 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj"] Jun 14 19:15:24.715134 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:15:24.715110 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe6b319_afa3_4400_b290_f85609148a54.slice/crio-252b824ccc33a9bd7a55d795995fda841820a6c9961638c5ec724a19947f11c1 WatchSource:0}: Error finding container 252b824ccc33a9bd7a55d795995fda841820a6c9961638c5ec724a19947f11c1: Status 404 returned error can't find the container with id 252b824ccc33a9bd7a55d795995fda841820a6c9961638c5ec724a19947f11c1 Jun 14 19:15:24.814304 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.814277 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd858cb59-4p4c2"] Jun 14 19:15:24.817173 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:15:24.817147 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92a6e81_06de_4ad1_9ade_44cabf511b38.slice/crio-ea6970b5ce09825a77e99950a9ec2ceebc831720be11f660c2990db6e4c8edb3 WatchSource:0}: Error finding container ea6970b5ce09825a77e99950a9ec2ceebc831720be11f660c2990db6e4c8edb3: Status 404 returned error can't find the container with id ea6970b5ce09825a77e99950a9ec2ceebc831720be11f660c2990db6e4c8edb3 Jun 14 19:15:24.943801 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.943765 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd858cb59-4p4c2" event={"ID":"f92a6e81-06de-4ad1-9ade-44cabf511b38","Type":"ContainerStarted","Data":"a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08"} Jun 14 19:15:24.944174 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.943820 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd858cb59-4p4c2" event={"ID":"f92a6e81-06de-4ad1-9ade-44cabf511b38","Type":"ContainerStarted","Data":"ea6970b5ce09825a77e99950a9ec2ceebc831720be11f660c2990db6e4c8edb3"} Jun 14 19:15:24.944921 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.944898 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" event={"ID":"1fe6b319-afa3-4400-b290-f85609148a54","Type":"ContainerStarted","Data":"252b824ccc33a9bd7a55d795995fda841820a6c9961638c5ec724a19947f11c1"} Jun 14 19:15:24.959604 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:24.959565 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cd858cb59-4p4c2" podStartSLOduration=0.959549609 podStartE2EDuration="959.549609ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:15:24.958899077 +0000 UTC m=+224.169830035" watchObservedRunningTime="2026-06-14 19:15:24.959549609 +0000 UTC m=+224.170480546" Jun 14 19:15:26.260015 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:26.259971 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:26.757414 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:26.757387 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:26.814324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:26.814293 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:26.877219 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:26.877198 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:26.954905 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:26.954871 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" event={"ID":"1fe6b319-afa3-4400-b290-f85609148a54","Type":"ContainerStarted","Data":"409d36fce697c9ed81782dda37c7fdbb5c9cf341311fb51b28a2d3dd270b89a1"} Jun 14 19:15:26.955050 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:26.954929 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" event={"ID":"1fe6b319-afa3-4400-b290-f85609148a54","Type":"ContainerStarted","Data":"085793522d5718de6e9d83351ad12fa37501697480b17dc9557c31b6c31eb704"} Jun 14 19:15:26.970502 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:26.970455 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qq6qj" podStartSLOduration=2.6727398190000002 podStartE2EDuration="3.970439334s" totalImagesPullingTime="1.297699515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:15:26.96883512 +0000 UTC m=+226.179766077" watchObservedRunningTime="2026-06-14 19:15:26.970439334 +0000 UTC m=+226.181370320" Jun 14 19:15:28.785988 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:28.785958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:29.023726 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.023663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:29.077126 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.077091 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l7vr5"] Jun 14 19:15:29.080624 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.080605 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.082822 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.082801 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 19:15:29.082928 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.082817 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 19:15:29.082928 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.082871 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x97r6\"" Jun 14 19:15:29.083052 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.082960 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 19:15:29.102160 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.102133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.102262 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.102165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7ss9\" (UniqueName: \"kubernetes.io/projected/04c1d322-0971-44be-9f06-8c358dfde8de-kube-api-access-j7ss9\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.102262 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.102185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04c1d322-0971-44be-9f06-8c358dfde8de-sys\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.102262 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.102241 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-textfile\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.102380 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.102289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.102380 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.102309 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c1d322-0971-44be-9f06-8c358dfde8de-metrics-client-ca\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.102380 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.102335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04c1d322-0971-44be-9f06-8c358dfde8de-root\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.102380 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.102353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-tls\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.102517 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.102389 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-wtmp\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.109468 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.109425 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:29.170299 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.170241 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:29.203699 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.203671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.203806 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.203705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c1d322-0971-44be-9f06-8c358dfde8de-metrics-client-ca\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.203806 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.203741 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04c1d322-0971-44be-9f06-8c358dfde8de-root\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.203806 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.203770 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-tls\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.203947 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.203807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-wtmp\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.203947 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.203870 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04c1d322-0971-44be-9f06-8c358dfde8de-root\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.203947 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.203906 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.203947 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.203945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7ss9\" (UniqueName: \"kubernetes.io/projected/04c1d322-0971-44be-9f06-8c358dfde8de-kube-api-access-j7ss9\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.204117 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.203965 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-wtmp\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.204117 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.203975 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04c1d322-0971-44be-9f06-8c358dfde8de-sys\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.204117 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.204030 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04c1d322-0971-44be-9f06-8c358dfde8de-sys\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.204285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.204170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-textfile\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.204467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.204447 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c1d322-0971-44be-9f06-8c358dfde8de-metrics-client-ca\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.204467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.204462 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-textfile\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.204576 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.204551 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.206148 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.206129 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-tls\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.206250 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.206139 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04c1d322-0971-44be-9f06-8c358dfde8de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.211518 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.211481 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7ss9\" (UniqueName: \"kubernetes.io/projected/04c1d322-0971-44be-9f06-8c358dfde8de-kube-api-access-j7ss9\") pod \"node-exporter-l7vr5\" (UID: \"04c1d322-0971-44be-9f06-8c358dfde8de\") " pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.221776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.221755 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:29.369972 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.369905 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:29.390024 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.389998 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l7vr5" Jun 14 19:15:29.401191 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:15:29.401165 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c1d322_0971_44be_9f06_8c358dfde8de.slice/crio-bd9bbf4a5b470c5691d5831a20398b02081dd1d3a7b1db23c88d828f39882555 WatchSource:0}: Error finding container bd9bbf4a5b470c5691d5831a20398b02081dd1d3a7b1db23c88d828f39882555: Status 404 returned error can't find the container with id bd9bbf4a5b470c5691d5831a20398b02081dd1d3a7b1db23c88d828f39882555 Jun 14 19:15:29.470602 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.470572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:29.545500 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.545475 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:29.801358 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.801330 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:29.968546 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:29.968509 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7vr5" event={"ID":"04c1d322-0971-44be-9f06-8c358dfde8de","Type":"ContainerStarted","Data":"bd9bbf4a5b470c5691d5831a20398b02081dd1d3a7b1db23c88d828f39882555"} Jun 14 19:15:30.001559 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:30.001525 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:30.091759 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:30.091677 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:30.314524 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:30.314492 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:30.497551 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:30.497516 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:30.497706 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:30.497595 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:15:30.498898 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:30.498873 2559 patch_prober.go:28] interesting pod/console-679695c9d4-54jjn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= Jun 14 19:15:30.499026 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:30.498909 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-679695c9d4-54jjn" podUID="1a9e3e6b-eb98-44b3-9d0a-9410263cb540" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" Jun 14 19:15:30.974193 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:30.974157 2559 generic.go:356] "Generic (PLEG): container finished" podID="04c1d322-0971-44be-9f06-8c358dfde8de" containerID="a108cc5bd6d2bebc244a04cb77d17c70023cb9182b7ee93fe9ff4f3a1e32a865" exitCode=0 Jun 14 19:15:30.974652 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:30.974265 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7vr5" event={"ID":"04c1d322-0971-44be-9f06-8c358dfde8de","Type":"ContainerDied","Data":"a108cc5bd6d2bebc244a04cb77d17c70023cb9182b7ee93fe9ff4f3a1e32a865"} Jun 14 19:15:31.632037 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:31.632007 2559 patch_prober.go:28] interesting pod/image-registry-8657cd5fd4-w8k9z container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 19:15:31.632201 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:31.632055 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" podUID="6b1eba42-38ff-4268-ba3c-2b002bab7bc1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 19:15:31.973860 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:31.973778 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:31.979247 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:31.979201 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7vr5" event={"ID":"04c1d322-0971-44be-9f06-8c358dfde8de","Type":"ContainerStarted","Data":"dbcea73cf9ce747a817ce2a8a3ef56f253ab7aafd81c1b772508ad0cc581df81"} Jun 14 19:15:31.979575 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:31.979305 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7vr5" event={"ID":"04c1d322-0971-44be-9f06-8c358dfde8de","Type":"ContainerStarted","Data":"403b2d42fa3570ff18e0b38e67098a9b292f72eb92c9309ac488931756abaa44"} Jun 14 19:15:32.004361 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:32.004315 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l7vr5" podStartSLOduration=1.967867676 podStartE2EDuration="3.004301743s" totalImagesPullingTime="973.962079ms" totalInitContainerRuntime="62.471988ms" isStatefulPod=true podCreationTimestamp="2026-06-14 19:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:15:32.003106548 +0000 UTC m=+231.214037502" watchObservedRunningTime="2026-06-14 19:15:32.004301743 +0000 UTC m=+231.215232700" Jun 14 19:15:32.076910 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:32.076859 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:32.191658 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:32.191627 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:32.378538 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:32.378505 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:32.480746 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:32.480720 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:32.668518 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:32.668444 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:33.528303 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:33.528248 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:33.629129 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:33.629105 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:33.806033 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:33.805987 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:33.824745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:33.824721 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679695c9d4-54jjn"] Jun 14 19:15:33.882810 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:33.882785 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:34.036327 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:34.036294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:34.692953 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:34.692916 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:34.693452 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:34.692990 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:15:34.694294 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:34.694271 2559 patch_prober.go:28] interesting pod/console-5cd858cb59-4p4c2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 14 19:15:34.694393 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:34.694314 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cd858cb59-4p4c2" podUID="f92a6e81-06de-4ad1-9ade-44cabf511b38" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 14 19:15:35.213823 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:35.213789 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:36.651856 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.651814 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" podUID="6b1eba42-38ff-4268-ba3c-2b002bab7bc1" containerName="registry" containerID="cri-o://c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b" gracePeriod=30 Jun 14 19:15:36.888604 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.888580 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:15:36.960548 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.960479 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg55q\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-kube-api-access-tg55q\") pod \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " Jun 14 19:15:36.960548 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.960510 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-certificates\") pod \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " Jun 14 19:15:36.960548 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.960533 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-bound-sa-token\") pod \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " Jun 14 19:15:36.960739 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.960554 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls\") pod \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " Jun 14 19:15:36.960739 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.960617 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-trusted-ca\") pod \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " Jun 14 19:15:36.960739 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.960670 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-installation-pull-secrets\") pod \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " Jun 14 19:15:36.960739 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.960704 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-image-registry-private-configuration\") pod \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " Jun 14 19:15:36.960739 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.960737 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-ca-trust-extracted\") pod \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\" (UID: \"6b1eba42-38ff-4268-ba3c-2b002bab7bc1\") " Jun 14 19:15:36.960965 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.960872 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6b1eba42-38ff-4268-ba3c-2b002bab7bc1" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:15:36.961025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.960993 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-certificates\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:15:36.961599 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.961550 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6b1eba42-38ff-4268-ba3c-2b002bab7bc1" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:15:36.962936 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.962909 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-kube-api-access-tg55q" (OuterVolumeSpecName: "kube-api-access-tg55q") pod "6b1eba42-38ff-4268-ba3c-2b002bab7bc1" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1"). InnerVolumeSpecName "kube-api-access-tg55q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:15:36.963030 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.962944 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6b1eba42-38ff-4268-ba3c-2b002bab7bc1" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:15:36.963173 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.963141 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6b1eba42-38ff-4268-ba3c-2b002bab7bc1" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:15:36.963291 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.963271 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6b1eba42-38ff-4268-ba3c-2b002bab7bc1" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 19:15:36.963413 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.963388 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6b1eba42-38ff-4268-ba3c-2b002bab7bc1" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 19:15:36.969399 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.969376 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6b1eba42-38ff-4268-ba3c-2b002bab7bc1" (UID: "6b1eba42-38ff-4268-ba3c-2b002bab7bc1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:15:36.995927 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.995901 2559 generic.go:356] "Generic (PLEG): container finished" podID="6b1eba42-38ff-4268-ba3c-2b002bab7bc1" containerID="c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b" exitCode=0 Jun 14 19:15:36.996032 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.995944 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" Jun 14 19:15:36.996032 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.995991 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" event={"ID":"6b1eba42-38ff-4268-ba3c-2b002bab7bc1","Type":"ContainerDied","Data":"c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b"} Jun 14 19:15:36.996103 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.996037 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8657cd5fd4-w8k9z" event={"ID":"6b1eba42-38ff-4268-ba3c-2b002bab7bc1","Type":"ContainerDied","Data":"93b4c4910852d337f92cd3a7cbc72bbc175c2b12b70266e129e46e1ecf24f5c2"} Jun 14 19:15:36.996103 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:36.996058 2559 scope.go:117] "RemoveContainer" containerID="c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b" Jun 14 19:15:37.004316 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.004300 2559 scope.go:117] "RemoveContainer" containerID="c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b" Jun 14 19:15:37.004611 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:15:37.004588 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b\": container with ID starting with c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b not found: ID does not exist" containerID="c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b" Jun 14 19:15:37.004685 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.004619 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b"} err="failed to get container status \"c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b\": rpc error: code = NotFound desc = could not find container \"c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b\": container with ID starting with c074273fa989a4bc0e4fb2b3154b529bf5f23f4c52893c2e94fb881363a9df1b not found: ID does not exist" Jun 14 19:15:37.015700 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.015680 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8657cd5fd4-w8k9z"] Jun 14 19:15:37.019661 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.019642 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8657cd5fd4-w8k9z"] Jun 14 19:15:37.062193 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.062173 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-image-registry-private-configuration\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:15:37.062193 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.062192 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-ca-trust-extracted\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:15:37.062320 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.062202 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg55q\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-kube-api-access-tg55q\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:15:37.062320 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.062211 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-bound-sa-token\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:15:37.062320 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.062220 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-registry-tls\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:15:37.062320 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.062242 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-trusted-ca\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:15:37.062320 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.062251 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b1eba42-38ff-4268-ba3c-2b002bab7bc1-installation-pull-secrets\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:15:37.264462 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:37.264404 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b1eba42-38ff-4268-ba3c-2b002bab7bc1" path="/var/lib/kubelet/pods/6b1eba42-38ff-4268-ba3c-2b002bab7bc1/volumes" Jun 14 19:15:39.383783 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:39.383755 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:39.433202 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:39.433177 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:44.692983 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:44.692947 2559 patch_prober.go:28] interesting pod/console-5cd858cb59-4p4c2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 14 19:15:44.693433 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:44.693018 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cd858cb59-4p4c2" podUID="f92a6e81-06de-4ad1-9ade-44cabf511b38" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 14 19:15:48.955656 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:48.955624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:49.004176 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:49.004150 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:49.102996 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:49.102968 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:49.154158 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:49.154133 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:53.179154 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:53.179120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:15:53.181342 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:53.181323 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f3c97e-2793-4a18-bc01-3aba6313fd48-metrics-certs\") pod \"network-metrics-daemon-64h8v\" (UID: \"e2f3c97e-2793-4a18-bc01-3aba6313fd48\") " pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:15:53.262535 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:53.262509 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m44tw\"" Jun 14 19:15:53.270976 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:53.270952 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64h8v" Jun 14 19:15:53.396747 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:53.396714 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-64h8v"] Jun 14 19:15:53.399475 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:15:53.399451 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f3c97e_2793_4a18_bc01_3aba6313fd48.slice/crio-80fec5dc004ba9850ca5321df348ace8463833b3ef939876b739b5283e32d4f7 WatchSource:0}: Error finding container 80fec5dc004ba9850ca5321df348ace8463833b3ef939876b739b5283e32d4f7: Status 404 returned error can't find the container with id 80fec5dc004ba9850ca5321df348ace8463833b3ef939876b739b5283e32d4f7 Jun 14 19:15:54.061339 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:54.061298 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64h8v" event={"ID":"e2f3c97e-2793-4a18-bc01-3aba6313fd48","Type":"ContainerStarted","Data":"80fec5dc004ba9850ca5321df348ace8463833b3ef939876b739b5283e32d4f7"} Jun 14 19:15:54.692786 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:54.692681 2559 patch_prober.go:28] interesting pod/console-5cd858cb59-4p4c2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 14 19:15:54.692786 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:54.692738 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cd858cb59-4p4c2" podUID="f92a6e81-06de-4ad1-9ade-44cabf511b38" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 14 19:15:55.066326 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:55.066297 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64h8v" event={"ID":"e2f3c97e-2793-4a18-bc01-3aba6313fd48","Type":"ContainerStarted","Data":"b74e9d7c931624e36115b824c50147ea87d143570d0193d0c7015b7db2a90e83"} Jun 14 19:15:55.066484 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:55.066346 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64h8v" event={"ID":"e2f3c97e-2793-4a18-bc01-3aba6313fd48","Type":"ContainerStarted","Data":"2b81c1dcc0b672c93f790dc1d1285b8f55766414d65179a2cbe9c9ad446af564"} Jun 14 19:15:55.081160 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:55.081115 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-64h8v" podStartSLOduration=253.266694446 podStartE2EDuration="4m14.081100224s" totalImagesPullingTime="814.405778ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:15:55.079461188 +0000 UTC m=+254.290392179" watchObservedRunningTime="2026-06-14 19:15:55.081100224 +0000 UTC m=+254.292031183" Jun 14 19:15:55.162535 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:55.162504 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:55.218348 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:55.218322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:58.532423 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:58.532393 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:58.582510 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:58.582476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:15:58.846197 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:15:58.846161 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-679695c9d4-54jjn" podUID="1a9e3e6b-eb98-44b3-9d0a-9410263cb540" containerName="console" containerID="cri-o://0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518" gracePeriod=15 Jun 14 19:16:04.692900 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:04.692866 2559 patch_prober.go:28] interesting pod/console-5cd858cb59-4p4c2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 14 19:16:04.693289 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:04.692932 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cd858cb59-4p4c2" podUID="f92a6e81-06de-4ad1-9ade-44cabf511b38" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 14 19:16:08.014147 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:08.014111 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:08.114905 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:08.114874 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:08.980292 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:08.980269 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:16:09.105324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.105298 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbtpd\" (UniqueName: \"kubernetes.io/projected/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-kube-api-access-sbtpd\") pod \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " Jun 14 19:16:09.105692 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.105355 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-serving-cert\") pod \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " Jun 14 19:16:09.105692 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.105384 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-service-ca\") pod \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " Jun 14 19:16:09.105692 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.105406 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-oauth-serving-cert\") pod \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " Jun 14 19:16:09.105692 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.105422 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-oauth-config\") pod \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " Jun 14 19:16:09.105692 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.105443 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-config\") pod \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\" (UID: \"1a9e3e6b-eb98-44b3-9d0a-9410263cb540\") " Jun 14 19:16:09.105919 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.105795 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-service-ca" (OuterVolumeSpecName: "service-ca") pod "1a9e3e6b-eb98-44b3-9d0a-9410263cb540" (UID: "1a9e3e6b-eb98-44b3-9d0a-9410263cb540"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:16:09.105919 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.105803 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1a9e3e6b-eb98-44b3-9d0a-9410263cb540" (UID: "1a9e3e6b-eb98-44b3-9d0a-9410263cb540"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:16:09.105919 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.105858 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-config" (OuterVolumeSpecName: "console-config") pod "1a9e3e6b-eb98-44b3-9d0a-9410263cb540" (UID: "1a9e3e6b-eb98-44b3-9d0a-9410263cb540"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:16:09.107477 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.107456 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-kube-api-access-sbtpd" (OuterVolumeSpecName: "kube-api-access-sbtpd") pod "1a9e3e6b-eb98-44b3-9d0a-9410263cb540" (UID: "1a9e3e6b-eb98-44b3-9d0a-9410263cb540"). InnerVolumeSpecName "kube-api-access-sbtpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:16:09.107554 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.107483 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1a9e3e6b-eb98-44b3-9d0a-9410263cb540" (UID: "1a9e3e6b-eb98-44b3-9d0a-9410263cb540"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 19:16:09.107590 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.107563 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1a9e3e6b-eb98-44b3-9d0a-9410263cb540" (UID: "1a9e3e6b-eb98-44b3-9d0a-9410263cb540"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 19:16:09.117074 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.117053 2559 generic.go:356] "Generic (PLEG): container finished" podID="1a9e3e6b-eb98-44b3-9d0a-9410263cb540" containerID="0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518" exitCode=0 Jun 14 19:16:09.117168 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.117090 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679695c9d4-54jjn" Jun 14 19:16:09.117168 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.117108 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679695c9d4-54jjn" event={"ID":"1a9e3e6b-eb98-44b3-9d0a-9410263cb540","Type":"ContainerDied","Data":"0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518"} Jun 14 19:16:09.117168 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.117146 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679695c9d4-54jjn" event={"ID":"1a9e3e6b-eb98-44b3-9d0a-9410263cb540","Type":"ContainerDied","Data":"0580fea2e28390e9d308ef999d69cef56c99c1626e068136c0da00fcaeec1082"} Jun 14 19:16:09.117168 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.117165 2559 scope.go:117] "RemoveContainer" containerID="0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518" Jun 14 19:16:09.125436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.125345 2559 scope.go:117] "RemoveContainer" containerID="0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518" Jun 14 19:16:09.125649 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:16:09.125626 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518\": container with ID starting with 0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518 not found: ID does not exist" containerID="0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518" Jun 14 19:16:09.125729 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.125658 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518"} err="failed to get container status \"0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518\": rpc error: code = NotFound desc = could not find container \"0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518\": container with ID starting with 0981f1137472c0400b5ef45417670a95e4e5bc55de6e2cad9d429193944e1518 not found: ID does not exist" Jun 14 19:16:09.138299 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.138275 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679695c9d4-54jjn"] Jun 14 19:16:09.142944 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.142923 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-679695c9d4-54jjn"] Jun 14 19:16:09.206386 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.206366 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-config\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:09.206386 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.206387 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbtpd\" (UniqueName: \"kubernetes.io/projected/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-kube-api-access-sbtpd\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:09.206518 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.206396 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-serving-cert\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:09.206518 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.206408 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-service-ca\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:09.206518 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.206416 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-oauth-serving-cert\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:09.206518 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.206423 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a9e3e6b-eb98-44b3-9d0a-9410263cb540-console-oauth-config\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:09.264052 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:09.264030 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a9e3e6b-eb98-44b3-9d0a-9410263cb540" path="/var/lib/kubelet/pods/1a9e3e6b-eb98-44b3-9d0a-9410263cb540/volumes" Jun 14 19:16:14.227397 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:14.227367 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd858cb59-4p4c2"] Jun 14 19:16:14.326013 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:14.325977 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:15.289031 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:15.289000 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:17.229630 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:17.229597 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:17.330347 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:17.330316 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:17.693970 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:17.693917 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:17.794726 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:17.794693 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:17.843920 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:17.843889 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:21.728563 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:16:21.728527 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7tp75" podUID="be35fe5c-838a-4bd4-b0b5-0c6632fcdb89" Jun 14 19:16:22.162438 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:22.162406 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7tp75" Jun 14 19:16:25.021735 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:25.021692 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:16:25.023969 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:25.023938 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be35fe5c-838a-4bd4-b0b5-0c6632fcdb89-metrics-tls\") pod \"dns-default-7tp75\" (UID: \"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89\") " pod="openshift-dns/dns-default-7tp75" Jun 14 19:16:25.165482 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:25.165457 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nf5nn\"" Jun 14 19:16:25.173916 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:25.173896 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7tp75" Jun 14 19:16:25.298412 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:25.298384 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7tp75"] Jun 14 19:16:25.302285 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:16:25.302213 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe35fe5c_838a_4bd4_b0b5_0c6632fcdb89.slice/crio-ddb98cda550814251374b1b81345e8ecbc5f0a5be5a00a06a9d9ba600c305060 WatchSource:0}: Error finding container ddb98cda550814251374b1b81345e8ecbc5f0a5be5a00a06a9d9ba600c305060: Status 404 returned error can't find the container with id ddb98cda550814251374b1b81345e8ecbc5f0a5be5a00a06a9d9ba600c305060 Jun 14 19:16:25.383494 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:25.383437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:25.441349 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:25.441326 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:26.177339 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:26.177301 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7tp75" event={"ID":"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89","Type":"ContainerStarted","Data":"ddb98cda550814251374b1b81345e8ecbc5f0a5be5a00a06a9d9ba600c305060"} Jun 14 19:16:26.998481 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:26.998452 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:27.100611 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:27.100528 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:27.182714 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:27.182682 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7tp75" event={"ID":"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89","Type":"ContainerStarted","Data":"671f7d4c41464f5f76c1547f0e2e4847cbbbbdaab4ca95ccfb2b81b61e8b8dd5"} Jun 14 19:16:27.183066 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:27.182767 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7tp75" event={"ID":"be35fe5c-838a-4bd4-b0b5-0c6632fcdb89","Type":"ContainerStarted","Data":"a780a94692611d2a4680f4ad023312dd7f0f8948dc1cf23ca774fd35df7c8580"} Jun 14 19:16:27.183066 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:27.182832 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7tp75" Jun 14 19:16:27.200181 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:27.200138 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7tp75" podStartSLOduration=250.680776001 podStartE2EDuration="4m12.200120244s" totalImagesPullingTime="1.519344243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:16:27.198542275 +0000 UTC m=+286.409473241" watchObservedRunningTime="2026-06-14 19:16:27.200120244 +0000 UTC m=+286.411051200" Jun 14 19:16:32.236392 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:32.236354 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:32.336491 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:32.336456 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:36.111804 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:36.111771 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:36.163856 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:36.163830 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:37.189078 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:37.189031 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7tp75" Jun 14 19:16:39.247056 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.246995 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cd858cb59-4p4c2" podUID="f92a6e81-06de-4ad1-9ade-44cabf511b38" containerName="console" containerID="cri-o://a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08" gracePeriod=15 Jun 14 19:16:39.476651 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.476628 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:16:39.518211 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.518158 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfc6h\" (UniqueName: \"kubernetes.io/projected/f92a6e81-06de-4ad1-9ade-44cabf511b38-kube-api-access-zfc6h\") pod \"f92a6e81-06de-4ad1-9ade-44cabf511b38\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " Jun 14 19:16:39.518211 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.518198 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-oauth-config\") pod \"f92a6e81-06de-4ad1-9ade-44cabf511b38\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " Jun 14 19:16:39.518382 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.518242 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-service-ca\") pod \"f92a6e81-06de-4ad1-9ade-44cabf511b38\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " Jun 14 19:16:39.518382 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.518270 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-oauth-serving-cert\") pod \"f92a6e81-06de-4ad1-9ade-44cabf511b38\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " Jun 14 19:16:39.518382 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.518288 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-serving-cert\") pod \"f92a6e81-06de-4ad1-9ade-44cabf511b38\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " Jun 14 19:16:39.518382 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.518304 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-trusted-ca-bundle\") pod \"f92a6e81-06de-4ad1-9ade-44cabf511b38\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " Jun 14 19:16:39.518382 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.518321 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-config\") pod \"f92a6e81-06de-4ad1-9ade-44cabf511b38\" (UID: \"f92a6e81-06de-4ad1-9ade-44cabf511b38\") " Jun 14 19:16:39.518771 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.518740 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f92a6e81-06de-4ad1-9ade-44cabf511b38" (UID: "f92a6e81-06de-4ad1-9ade-44cabf511b38"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:16:39.518886 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.518735 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-service-ca" (OuterVolumeSpecName: "service-ca") pod "f92a6e81-06de-4ad1-9ade-44cabf511b38" (UID: "f92a6e81-06de-4ad1-9ade-44cabf511b38"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:16:39.518886 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.518774 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-config" (OuterVolumeSpecName: "console-config") pod "f92a6e81-06de-4ad1-9ade-44cabf511b38" (UID: "f92a6e81-06de-4ad1-9ade-44cabf511b38"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:16:39.518886 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.518786 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f92a6e81-06de-4ad1-9ade-44cabf511b38" (UID: "f92a6e81-06de-4ad1-9ade-44cabf511b38"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:16:39.520337 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.520299 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f92a6e81-06de-4ad1-9ade-44cabf511b38" (UID: "f92a6e81-06de-4ad1-9ade-44cabf511b38"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 19:16:39.520762 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.520746 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92a6e81-06de-4ad1-9ade-44cabf511b38-kube-api-access-zfc6h" (OuterVolumeSpecName: "kube-api-access-zfc6h") pod "f92a6e81-06de-4ad1-9ade-44cabf511b38" (UID: "f92a6e81-06de-4ad1-9ade-44cabf511b38"). InnerVolumeSpecName "kube-api-access-zfc6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:16:39.520814 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.520761 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f92a6e81-06de-4ad1-9ade-44cabf511b38" (UID: "f92a6e81-06de-4ad1-9ade-44cabf511b38"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 19:16:39.619100 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.619075 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-oauth-config\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:39.619100 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.619097 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-service-ca\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:39.619261 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.619111 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-oauth-serving-cert\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:39.619261 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.619124 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-serving-cert\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:39.619261 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.619135 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-trusted-ca-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:39.619261 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.619147 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f92a6e81-06de-4ad1-9ade-44cabf511b38-console-config\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:39.619261 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.619159 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfc6h\" (UniqueName: \"kubernetes.io/projected/f92a6e81-06de-4ad1-9ade-44cabf511b38-kube-api-access-zfc6h\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:16:39.993175 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:39.993143 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:40.091760 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:40.091734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:40.192513 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:40.192483 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:40.228705 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:40.228674 2559 generic.go:356] "Generic (PLEG): container finished" podID="f92a6e81-06de-4ad1-9ade-44cabf511b38" containerID="a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08" exitCode=0 Jun 14 19:16:40.228830 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:40.228718 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd858cb59-4p4c2" Jun 14 19:16:40.228830 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:40.228730 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd858cb59-4p4c2" event={"ID":"f92a6e81-06de-4ad1-9ade-44cabf511b38","Type":"ContainerDied","Data":"a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08"} Jun 14 19:16:40.228830 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:40.228776 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd858cb59-4p4c2" event={"ID":"f92a6e81-06de-4ad1-9ade-44cabf511b38","Type":"ContainerDied","Data":"ea6970b5ce09825a77e99950a9ec2ceebc831720be11f660c2990db6e4c8edb3"} Jun 14 19:16:40.228830 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:40.228802 2559 scope.go:117] "RemoveContainer" containerID="a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08" Jun 14 19:16:40.237131 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:40.237114 2559 scope.go:117] "RemoveContainer" containerID="a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08" Jun 14 19:16:40.237410 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:16:40.237392 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08\": container with ID starting with a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08 not found: ID does not exist" containerID="a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08" Jun 14 19:16:40.237481 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:40.237420 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08"} err="failed to get container status \"a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08\": rpc error: code = NotFound desc = could not find container \"a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08\": container with ID starting with a08399e76bf19df70efea7a3c5f688286a2ef8e7623b8f250df8e6c170063e08 not found: ID does not exist" Jun 14 19:16:40.247355 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:40.247309 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd858cb59-4p4c2"] Jun 14 19:16:40.250829 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:40.250811 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cd858cb59-4p4c2"] Jun 14 19:16:41.201551 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:41.201524 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:16:41.205450 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:41.205431 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:16:41.206211 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:41.206194 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:16:41.210716 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:41.210624 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:16:41.212606 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:41.212581 2559 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 19:16:41.264666 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:41.264550 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f92a6e81-06de-4ad1-9ade-44cabf511b38" path="/var/lib/kubelet/pods/f92a6e81-06de-4ad1-9ade-44cabf511b38/volumes" Jun 14 19:16:44.400276 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:44.400241 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:44.498948 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:44.498909 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:44.547897 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:44.547867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:46.304155 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:46.304128 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:46.356625 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:46.356595 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:47.231757 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:47.231728 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:47.331515 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:47.331483 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:48.222707 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:48.222676 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:48.624661 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:48.624630 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:53.342403 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.342369 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67b89458f8-hlps6"] Jun 14 19:16:53.342790 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.342609 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f92a6e81-06de-4ad1-9ade-44cabf511b38" containerName="console" Jun 14 19:16:53.342790 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.342621 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f92a6e81-06de-4ad1-9ade-44cabf511b38" containerName="console" Jun 14 19:16:53.342790 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.342634 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a9e3e6b-eb98-44b3-9d0a-9410263cb540" containerName="console" Jun 14 19:16:53.342790 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.342642 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a9e3e6b-eb98-44b3-9d0a-9410263cb540" containerName="console" Jun 14 19:16:53.342790 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.342654 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b1eba42-38ff-4268-ba3c-2b002bab7bc1" containerName="registry" Jun 14 19:16:53.342790 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.342659 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b1eba42-38ff-4268-ba3c-2b002bab7bc1" containerName="registry" Jun 14 19:16:53.342790 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.342709 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a9e3e6b-eb98-44b3-9d0a-9410263cb540" containerName="console" Jun 14 19:16:53.342790 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.342716 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b1eba42-38ff-4268-ba3c-2b002bab7bc1" containerName="registry" Jun 14 19:16:53.342790 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.342723 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f92a6e81-06de-4ad1-9ade-44cabf511b38" containerName="console" Jun 14 19:16:53.344796 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.344761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.347292 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.347263 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 14 19:16:53.347497 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.347477 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 14 19:16:53.347698 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.347679 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 14 19:16:53.347897 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.347880 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 14 19:16:53.347966 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.347901 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qmrs9\"" Jun 14 19:16:53.348991 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.348956 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 14 19:16:53.351742 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.351721 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 14 19:16:53.358462 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.358435 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67b89458f8-hlps6"] Jun 14 19:16:53.421468 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.421429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.421468 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.421466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-telemeter-client-tls\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.421688 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.421505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-secret-telemeter-client\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.421688 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.421537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.421688 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.421595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-serving-certs-ca-bundle\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.421688 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.421624 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k92t8\" (UniqueName: \"kubernetes.io/projected/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-kube-api-access-k92t8\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.421830 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.421705 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-federate-client-tls\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.421830 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.421746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-metrics-client-ca\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.522855 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.522818 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-federate-client-tls\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.522855 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.522859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-metrics-client-ca\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.523057 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.522883 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.523057 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.522995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-telemeter-client-tls\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.523057 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.523036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-secret-telemeter-client\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.523217 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.523076 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.523217 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.523110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-serving-certs-ca-bundle\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.523356 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.523304 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k92t8\" (UniqueName: \"kubernetes.io/projected/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-kube-api-access-k92t8\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.523708 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.523684 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-metrics-client-ca\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.523893 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.523774 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.524184 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.524159 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-serving-certs-ca-bundle\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.525574 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.525548 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-secret-telemeter-client\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.525648 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.525573 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-telemeter-client-tls\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.525648 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.525629 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-federate-client-tls\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.525724 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.525707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.532895 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.532872 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k92t8\" (UniqueName: \"kubernetes.io/projected/6c9633f0-c0ff-4d39-9c03-5e15c52169b6-kube-api-access-k92t8\") pod \"telemeter-client-67b89458f8-hlps6\" (UID: \"6c9633f0-c0ff-4d39-9c03-5e15c52169b6\") " pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.654757 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.654678 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" Jun 14 19:16:53.779579 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.779551 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67b89458f8-hlps6"] Jun 14 19:16:53.783187 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:16:53.783159 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9633f0_c0ff_4d39_9c03_5e15c52169b6.slice/crio-ede6e51d705a66926a12c435056aceaf7dc29ade846bfdfbf2bae03c16c8f234 WatchSource:0}: Error finding container ede6e51d705a66926a12c435056aceaf7dc29ade846bfdfbf2bae03c16c8f234: Status 404 returned error can't find the container with id ede6e51d705a66926a12c435056aceaf7dc29ade846bfdfbf2bae03c16c8f234 Jun 14 19:16:53.785033 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:53.785018 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 19:16:54.278420 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:54.278379 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" event={"ID":"6c9633f0-c0ff-4d39-9c03-5e15c52169b6","Type":"ContainerStarted","Data":"ede6e51d705a66926a12c435056aceaf7dc29ade846bfdfbf2bae03c16c8f234"} Jun 14 19:16:56.288540 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:56.288503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" event={"ID":"6c9633f0-c0ff-4d39-9c03-5e15c52169b6","Type":"ContainerStarted","Data":"55f8002b21fea1066f91eb919d44d7f832f1e5ec0fdab1d5566ddc49aa69ad0a"} Jun 14 19:16:57.294036 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.294001 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" event={"ID":"6c9633f0-c0ff-4d39-9c03-5e15c52169b6","Type":"ContainerStarted","Data":"ee498726f3a59d276b88f0e9c5ff101951b6bc9b215f044f90e9346676004e5a"} Jun 14 19:16:57.294532 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.294051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" event={"ID":"6c9633f0-c0ff-4d39-9c03-5e15c52169b6","Type":"ContainerStarted","Data":"c25b04a73c99d2648bf7b4fa30d151ac8cd48df9fd92fa61718012bfb4fc4fc3"} Jun 14 19:16:57.974472 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.974406 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67b89458f8-hlps6" podStartSLOduration=2.175716639 podStartE2EDuration="4.974381221s" totalImagesPullingTime="2.798664582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:16:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:16:57.317736271 +0000 UTC m=+316.528667230" watchObservedRunningTime="2026-06-14 19:16:57.974381221 +0000 UTC m=+317.185312177" Jun 14 19:16:57.975076 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.975060 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f495b85b-jdd5s"] Jun 14 19:16:57.977313 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.977287 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:57.979507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.979426 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 19:16:57.979726 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.979707 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 19:16:57.979726 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.979721 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mxpzn\"" Jun 14 19:16:57.979849 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.979716 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 19:16:57.980488 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.980303 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 19:16:57.980488 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.980351 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 19:16:57.980488 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.980348 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 19:16:57.980488 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.980390 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 19:16:57.984031 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.984015 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 19:16:57.989552 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:57.989531 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f495b85b-jdd5s"] Jun 14 19:16:58.023173 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.023150 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:58.059378 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.059354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krb5t\" (UniqueName: \"kubernetes.io/projected/cf1b709b-464a-4876-ad1c-d2b21a9ab269-kube-api-access-krb5t\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.059478 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.059391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-service-ca\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.059478 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.059412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-oauth-serving-cert\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.059478 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.059432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-trusted-ca-bundle\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.059594 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.059475 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-serving-cert\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.059594 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.059533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-config\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.059594 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.059558 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-oauth-config\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.123752 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.123718 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:58.160017 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.159994 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-service-ca\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.160129 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.160023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-oauth-serving-cert\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.160129 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.160046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-trusted-ca-bundle\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.160129 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.160064 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-serving-cert\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.160129 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.160095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-config\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.160129 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.160127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-oauth-config\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.160467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.160177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krb5t\" (UniqueName: \"kubernetes.io/projected/cf1b709b-464a-4876-ad1c-d2b21a9ab269-kube-api-access-krb5t\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.160821 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.160801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-service-ca\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.160972 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.160948 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-config\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.161016 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.160986 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-oauth-serving-cert\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.161053 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.161010 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-trusted-ca-bundle\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.162539 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.162510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-oauth-config\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.162672 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.162654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-serving-cert\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.167549 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.167526 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krb5t\" (UniqueName: \"kubernetes.io/projected/cf1b709b-464a-4876-ad1c-d2b21a9ab269-kube-api-access-krb5t\") pod \"console-54f495b85b-jdd5s\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.223858 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.223808 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:58.289213 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.289132 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:16:58.443790 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.443755 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f495b85b-jdd5s"] Jun 14 19:16:58.447973 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:16:58.447943 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1b709b_464a_4876_ad1c_d2b21a9ab269.slice/crio-91b474edfb9b21fdb9d96c87f482076c0ee9fa41ee9bcfd8ccecc0ae68dcf815 WatchSource:0}: Error finding container 91b474edfb9b21fdb9d96c87f482076c0ee9fa41ee9bcfd8ccecc0ae68dcf815: Status 404 returned error can't find the container with id 91b474edfb9b21fdb9d96c87f482076c0ee9fa41ee9bcfd8ccecc0ae68dcf815 Jun 14 19:16:58.830918 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.830834 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:58.931463 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:58.931429 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:16:59.303386 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:59.303358 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f495b85b-jdd5s" event={"ID":"cf1b709b-464a-4876-ad1c-d2b21a9ab269","Type":"ContainerStarted","Data":"ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7"} Jun 14 19:16:59.303580 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:59.303409 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f495b85b-jdd5s" event={"ID":"cf1b709b-464a-4876-ad1c-d2b21a9ab269","Type":"ContainerStarted","Data":"91b474edfb9b21fdb9d96c87f482076c0ee9fa41ee9bcfd8ccecc0ae68dcf815"} Jun 14 19:16:59.319378 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:16:59.319331 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54f495b85b-jdd5s" podStartSLOduration=2.319316137 podStartE2EDuration="2.319316137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:16:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:16:59.317930564 +0000 UTC m=+318.528861522" watchObservedRunningTime="2026-06-14 19:16:59.319316137 +0000 UTC m=+318.530247095" Jun 14 19:17:03.443768 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:03.443735 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:03.491181 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:03.491151 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:08.289303 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.289219 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:17:08.289723 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.289331 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:17:08.293916 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.293887 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:17:08.337455 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.337428 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:17:08.444278 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.444250 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-787497b4d4-8fvzx"] Jun 14 19:17:08.448538 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.448513 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.455657 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.455631 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787497b4d4-8fvzx"] Jun 14 19:17:08.542278 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.542191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-service-ca\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.542278 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.542263 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnl4h\" (UniqueName: \"kubernetes.io/projected/330888b5-c6d8-48ba-96c5-f4b1cdb89364-kube-api-access-qnl4h\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.542452 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.542307 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-trusted-ca-bundle\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.542452 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.542336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-serving-cert\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.542452 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.542355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-oauth-config\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.542452 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.542370 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-oauth-serving-cert\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.542452 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.542391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-config\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.643728 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.643698 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-serving-cert\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.643728 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.643729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-oauth-config\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.643939 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.643747 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-oauth-serving-cert\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.643939 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.643775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-config\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.643939 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.643813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-service-ca\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.643939 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.643843 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnl4h\" (UniqueName: \"kubernetes.io/projected/330888b5-c6d8-48ba-96c5-f4b1cdb89364-kube-api-access-qnl4h\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.644144 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.643996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-trusted-ca-bundle\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.644552 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.644532 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-service-ca\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.644658 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.644567 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-oauth-serving-cert\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.644658 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.644571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-config\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.644907 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.644889 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-trusted-ca-bundle\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.646627 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.646607 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-oauth-config\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.646727 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.646706 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-serving-cert\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.650788 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.650766 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnl4h\" (UniqueName: \"kubernetes.io/projected/330888b5-c6d8-48ba-96c5-f4b1cdb89364-kube-api-access-qnl4h\") pod \"console-787497b4d4-8fvzx\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.763899 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.763866 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:08.835879 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.835847 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:08.897830 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.897798 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787497b4d4-8fvzx"] Jun 14 19:17:08.900889 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:08.900865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:08.902044 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:17:08.902020 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330888b5_c6d8_48ba_96c5_f4b1cdb89364.slice/crio-9562e272eb0011f61c14e6b11583d9889c96af2d38dd8fd3703e9f7783ee06dd WatchSource:0}: Error finding container 9562e272eb0011f61c14e6b11583d9889c96af2d38dd8fd3703e9f7783ee06dd: Status 404 returned error can't find the container with id 9562e272eb0011f61c14e6b11583d9889c96af2d38dd8fd3703e9f7783ee06dd Jun 14 19:17:09.339042 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:09.339009 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787497b4d4-8fvzx" event={"ID":"330888b5-c6d8-48ba-96c5-f4b1cdb89364","Type":"ContainerStarted","Data":"218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8"} Jun 14 19:17:09.339431 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:09.339053 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787497b4d4-8fvzx" event={"ID":"330888b5-c6d8-48ba-96c5-f4b1cdb89364","Type":"ContainerStarted","Data":"9562e272eb0011f61c14e6b11583d9889c96af2d38dd8fd3703e9f7783ee06dd"} Jun 14 19:17:09.355306 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:09.355254 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-787497b4d4-8fvzx" podStartSLOduration=1.355213638 podStartE2EDuration="1.355213638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:17:09.353474588 +0000 UTC m=+328.564405545" watchObservedRunningTime="2026-06-14 19:17:09.355213638 +0000 UTC m=+328.566144595" Jun 14 19:17:09.430199 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:09.430165 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:09.476638 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:09.476612 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:11.909570 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:11.909540 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:11.954343 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:11.954314 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:16.006129 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:16.006095 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:16.107442 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:16.107411 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:18.764609 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:18.764574 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:18.765035 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:18.764655 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:18.769566 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:18.769544 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:19.376235 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:19.376186 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:17:19.416469 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:19.416435 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f495b85b-jdd5s"] Jun 14 19:17:19.517275 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:19.517245 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:19.568274 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:19.568244 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:26.925564 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:26.925481 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:32.242141 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:32.242107 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:32.342722 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:32.342695 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:32.392495 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:32.392467 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:17:44.439032 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.438989 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54f495b85b-jdd5s" podUID="cf1b709b-464a-4876-ad1c-d2b21a9ab269" containerName="console" containerID="cri-o://ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7" gracePeriod=15 Jun 14 19:17:44.681544 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.681523 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:17:44.715887 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.715827 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-service-ca\") pod \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " Jun 14 19:17:44.715887 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.715866 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-oauth-config\") pod \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " Jun 14 19:17:44.716060 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.715899 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-trusted-ca-bundle\") pod \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " Jun 14 19:17:44.716060 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.715922 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krb5t\" (UniqueName: \"kubernetes.io/projected/cf1b709b-464a-4876-ad1c-d2b21a9ab269-kube-api-access-krb5t\") pod \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " Jun 14 19:17:44.716060 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.715942 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-serving-cert\") pod \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " Jun 14 19:17:44.716060 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.715958 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-config\") pod \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " Jun 14 19:17:44.716060 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.715974 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-oauth-serving-cert\") pod \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\" (UID: \"cf1b709b-464a-4876-ad1c-d2b21a9ab269\") " Jun 14 19:17:44.716347 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.716252 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf1b709b-464a-4876-ad1c-d2b21a9ab269" (UID: "cf1b709b-464a-4876-ad1c-d2b21a9ab269"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:17:44.716484 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.716456 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf1b709b-464a-4876-ad1c-d2b21a9ab269" (UID: "cf1b709b-464a-4876-ad1c-d2b21a9ab269"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:17:44.716601 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.716488 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-config" (OuterVolumeSpecName: "console-config") pod "cf1b709b-464a-4876-ad1c-d2b21a9ab269" (UID: "cf1b709b-464a-4876-ad1c-d2b21a9ab269"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:17:44.716601 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.716509 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf1b709b-464a-4876-ad1c-d2b21a9ab269" (UID: "cf1b709b-464a-4876-ad1c-d2b21a9ab269"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:17:44.717990 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.717971 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1b709b-464a-4876-ad1c-d2b21a9ab269-kube-api-access-krb5t" (OuterVolumeSpecName: "kube-api-access-krb5t") pod "cf1b709b-464a-4876-ad1c-d2b21a9ab269" (UID: "cf1b709b-464a-4876-ad1c-d2b21a9ab269"). InnerVolumeSpecName "kube-api-access-krb5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:17:44.718175 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.718151 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf1b709b-464a-4876-ad1c-d2b21a9ab269" (UID: "cf1b709b-464a-4876-ad1c-d2b21a9ab269"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 19:17:44.718374 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.718358 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf1b709b-464a-4876-ad1c-d2b21a9ab269" (UID: "cf1b709b-464a-4876-ad1c-d2b21a9ab269"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 19:17:44.816763 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.816741 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-serving-cert\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:17:44.816763 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.816762 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-config\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:17:44.816874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.816771 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-oauth-serving-cert\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:17:44.816874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.816780 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-service-ca\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:17:44.816874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.816789 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf1b709b-464a-4876-ad1c-d2b21a9ab269-console-oauth-config\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:17:44.816874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.816797 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf1b709b-464a-4876-ad1c-d2b21a9ab269-trusted-ca-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:17:44.816874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:44.816804 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krb5t\" (UniqueName: \"kubernetes.io/projected/cf1b709b-464a-4876-ad1c-d2b21a9ab269-kube-api-access-krb5t\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:17:45.459019 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:45.458985 2559 generic.go:356] "Generic (PLEG): container finished" podID="cf1b709b-464a-4876-ad1c-d2b21a9ab269" containerID="ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7" exitCode=0 Jun 14 19:17:45.459514 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:45.459030 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f495b85b-jdd5s" Jun 14 19:17:45.459514 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:45.459040 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f495b85b-jdd5s" event={"ID":"cf1b709b-464a-4876-ad1c-d2b21a9ab269","Type":"ContainerDied","Data":"ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7"} Jun 14 19:17:45.459514 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:45.459077 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f495b85b-jdd5s" event={"ID":"cf1b709b-464a-4876-ad1c-d2b21a9ab269","Type":"ContainerDied","Data":"91b474edfb9b21fdb9d96c87f482076c0ee9fa41ee9bcfd8ccecc0ae68dcf815"} Jun 14 19:17:45.459514 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:45.459097 2559 scope.go:117] "RemoveContainer" containerID="ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7" Jun 14 19:17:45.466896 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:45.466880 2559 scope.go:117] "RemoveContainer" containerID="ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7" Jun 14 19:17:45.467148 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:17:45.467128 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7\": container with ID starting with ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7 not found: ID does not exist" containerID="ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7" Jun 14 19:17:45.467189 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:45.467157 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7"} err="failed to get container status \"ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7\": rpc error: code = NotFound desc = could not find container \"ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7\": container with ID starting with ddae278f47b09d95956d25e239602ee6fd53c1356d8c5b2e59483180317a98c7 not found: ID does not exist" Jun 14 19:17:45.472128 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:45.472108 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f495b85b-jdd5s"] Jun 14 19:17:45.475732 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:45.475714 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f495b85b-jdd5s"] Jun 14 19:17:47.264124 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:17:47.264090 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1b709b-464a-4876-ad1c-d2b21a9ab269" path="/var/lib/kubelet/pods/cf1b709b-464a-4876-ad1c-d2b21a9ab269/volumes" Jun 14 19:18:12.274337 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.274307 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:12.375744 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.375716 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:12.859950 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.859916 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw"] Jun 14 19:18:12.860212 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.860200 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1b709b-464a-4876-ad1c-d2b21a9ab269" containerName="console" Jun 14 19:18:12.860293 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.860215 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1b709b-464a-4876-ad1c-d2b21a9ab269" containerName="console" Jun 14 19:18:12.860293 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.860288 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1b709b-464a-4876-ad1c-d2b21a9ab269" containerName="console" Jun 14 19:18:12.863220 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.863203 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:12.865123 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.865103 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 19:18:12.865246 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.865201 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 19:18:12.865902 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.865882 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f4nrq\"" Jun 14 19:18:12.870552 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.870527 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw"] Jun 14 19:18:12.903308 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.903283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:12.903438 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.903355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:12.903438 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:12.903389 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds9mb\" (UniqueName: \"kubernetes.io/projected/cab017ca-c54e-434d-934f-e6951675b311-kube-api-access-ds9mb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:13.004034 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:13.004008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:13.004182 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:13.004058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:13.004182 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:13.004083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds9mb\" (UniqueName: \"kubernetes.io/projected/cab017ca-c54e-434d-934f-e6951675b311-kube-api-access-ds9mb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:13.004390 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:13.004369 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:13.004456 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:13.004432 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:13.011731 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:13.011706 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds9mb\" (UniqueName: \"kubernetes.io/projected/cab017ca-c54e-434d-934f-e6951675b311-kube-api-access-ds9mb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:13.173699 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:13.173630 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:13.298891 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:13.298862 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw"] Jun 14 19:18:13.301556 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:18:13.301527 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab017ca_c54e_434d_934f_e6951675b311.slice/crio-9018421fb64bbe16ec840fd88422126aefe11c57944d4c78e5279fec7630ca26 WatchSource:0}: Error finding container 9018421fb64bbe16ec840fd88422126aefe11c57944d4c78e5279fec7630ca26: Status 404 returned error can't find the container with id 9018421fb64bbe16ec840fd88422126aefe11c57944d4c78e5279fec7630ca26 Jun 14 19:18:13.566974 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:13.566946 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" event={"ID":"cab017ca-c54e-434d-934f-e6951675b311","Type":"ContainerStarted","Data":"9018421fb64bbe16ec840fd88422126aefe11c57944d4c78e5279fec7630ca26"} Jun 14 19:18:20.595755 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:20.595722 2559 generic.go:356] "Generic (PLEG): container finished" podID="cab017ca-c54e-434d-934f-e6951675b311" containerID="ae61a1cc8f82747c1f863a390edff52c89b4414ddd827c88dee6f8c977ebfc65" exitCode=0 Jun 14 19:18:20.596158 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:20.595804 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" event={"ID":"cab017ca-c54e-434d-934f-e6951675b311","Type":"ContainerDied","Data":"ae61a1cc8f82747c1f863a390edff52c89b4414ddd827c88dee6f8c977ebfc65"} Jun 14 19:18:23.608835 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:23.608794 2559 generic.go:356] "Generic (PLEG): container finished" podID="cab017ca-c54e-434d-934f-e6951675b311" containerID="2b5d39fda778cb3fe6da801e66a804000fc5ad24dc89186f4ff05dccf65371ed" exitCode=0 Jun 14 19:18:23.609201 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:23.608856 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" event={"ID":"cab017ca-c54e-434d-934f-e6951675b311","Type":"ContainerDied","Data":"2b5d39fda778cb3fe6da801e66a804000fc5ad24dc89186f4ff05dccf65371ed"} Jun 14 19:18:30.637447 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:30.637404 2559 generic.go:356] "Generic (PLEG): container finished" podID="cab017ca-c54e-434d-934f-e6951675b311" containerID="5c13eb546dc77653d0e3bb042d268911f30bf87a700bbe92deee58747b8109b8" exitCode=0 Jun 14 19:18:30.637835 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:30.637464 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" event={"ID":"cab017ca-c54e-434d-934f-e6951675b311","Type":"ContainerDied","Data":"5c13eb546dc77653d0e3bb042d268911f30bf87a700bbe92deee58747b8109b8"} Jun 14 19:18:31.760675 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:31.760654 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:31.851044 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:31.851015 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-util\") pod \"cab017ca-c54e-434d-934f-e6951675b311\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " Jun 14 19:18:31.851204 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:31.851062 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-bundle\") pod \"cab017ca-c54e-434d-934f-e6951675b311\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " Jun 14 19:18:31.851204 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:31.851091 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds9mb\" (UniqueName: \"kubernetes.io/projected/cab017ca-c54e-434d-934f-e6951675b311-kube-api-access-ds9mb\") pod \"cab017ca-c54e-434d-934f-e6951675b311\" (UID: \"cab017ca-c54e-434d-934f-e6951675b311\") " Jun 14 19:18:31.851674 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:31.851647 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-bundle" (OuterVolumeSpecName: "bundle") pod "cab017ca-c54e-434d-934f-e6951675b311" (UID: "cab017ca-c54e-434d-934f-e6951675b311"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:18:31.853256 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:31.853214 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cab017ca-c54e-434d-934f-e6951675b311-kube-api-access-ds9mb" (OuterVolumeSpecName: "kube-api-access-ds9mb") pod "cab017ca-c54e-434d-934f-e6951675b311" (UID: "cab017ca-c54e-434d-934f-e6951675b311"). InnerVolumeSpecName "kube-api-access-ds9mb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:18:31.855020 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:31.855001 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-util" (OuterVolumeSpecName: "util") pod "cab017ca-c54e-434d-934f-e6951675b311" (UID: "cab017ca-c54e-434d-934f-e6951675b311"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:18:31.951820 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:31.951727 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:18:31.951820 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:31.951767 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds9mb\" (UniqueName: \"kubernetes.io/projected/cab017ca-c54e-434d-934f-e6951675b311-kube-api-access-ds9mb\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:18:31.951820 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:31.951778 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cab017ca-c54e-434d-934f-e6951675b311-util\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:18:32.646858 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:32.646819 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" event={"ID":"cab017ca-c54e-434d-934f-e6951675b311","Type":"ContainerDied","Data":"9018421fb64bbe16ec840fd88422126aefe11c57944d4c78e5279fec7630ca26"} Jun 14 19:18:32.647015 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:32.646874 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9018421fb64bbe16ec840fd88422126aefe11c57944d4c78e5279fec7630ca26" Jun 14 19:18:32.647015 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:32.646839 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4blmw" Jun 14 19:18:33.784638 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:33.784587 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:34.614848 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:34.614818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:35.733381 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.733346 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4"] Jun 14 19:18:35.733754 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.733599 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab017ca-c54e-434d-934f-e6951675b311" containerName="extract" Jun 14 19:18:35.733754 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.733609 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab017ca-c54e-434d-934f-e6951675b311" containerName="extract" Jun 14 19:18:35.733754 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.733619 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab017ca-c54e-434d-934f-e6951675b311" containerName="util" Jun 14 19:18:35.733754 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.733625 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab017ca-c54e-434d-934f-e6951675b311" containerName="util" Jun 14 19:18:35.733754 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.733630 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab017ca-c54e-434d-934f-e6951675b311" containerName="pull" Jun 14 19:18:35.733754 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.733635 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab017ca-c54e-434d-934f-e6951675b311" containerName="pull" Jun 14 19:18:35.733754 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.733678 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cab017ca-c54e-434d-934f-e6951675b311" containerName="extract" Jun 14 19:18:35.785309 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.785271 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4"] Jun 14 19:18:35.785497 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.785383 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4" Jun 14 19:18:35.787327 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.787301 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ht2bw\"" Jun 14 19:18:35.787458 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.787359 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 14 19:18:35.787458 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.787415 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 14 19:18:35.885741 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.885707 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e22ab4-3850-4359-9c6d-74dd303766c0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j4kj4\" (UID: \"a2e22ab4-3850-4359-9c6d-74dd303766c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4" Jun 14 19:18:35.885905 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.885750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kvg6\" (UniqueName: \"kubernetes.io/projected/a2e22ab4-3850-4359-9c6d-74dd303766c0-kube-api-access-8kvg6\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j4kj4\" (UID: \"a2e22ab4-3850-4359-9c6d-74dd303766c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4" Jun 14 19:18:35.986719 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.986632 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e22ab4-3850-4359-9c6d-74dd303766c0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j4kj4\" (UID: \"a2e22ab4-3850-4359-9c6d-74dd303766c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4" Jun 14 19:18:35.986719 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.986682 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kvg6\" (UniqueName: \"kubernetes.io/projected/a2e22ab4-3850-4359-9c6d-74dd303766c0-kube-api-access-8kvg6\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j4kj4\" (UID: \"a2e22ab4-3850-4359-9c6d-74dd303766c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4" Jun 14 19:18:35.987041 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.987022 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e22ab4-3850-4359-9c6d-74dd303766c0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j4kj4\" (UID: \"a2e22ab4-3850-4359-9c6d-74dd303766c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4" Jun 14 19:18:35.996599 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:35.996576 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kvg6\" (UniqueName: \"kubernetes.io/projected/a2e22ab4-3850-4359-9c6d-74dd303766c0-kube-api-access-8kvg6\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j4kj4\" (UID: \"a2e22ab4-3850-4359-9c6d-74dd303766c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4" Jun 14 19:18:36.095063 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:36.095022 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4" Jun 14 19:18:36.242065 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:36.242039 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4"] Jun 14 19:18:36.244826 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:18:36.244800 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e22ab4_3850_4359_9c6d_74dd303766c0.slice/crio-e16ead5f135ed3d781e3a73f17c1998df11d9b2599cec55ab6670f7e5c96bfea WatchSource:0}: Error finding container e16ead5f135ed3d781e3a73f17c1998df11d9b2599cec55ab6670f7e5c96bfea: Status 404 returned error can't find the container with id e16ead5f135ed3d781e3a73f17c1998df11d9b2599cec55ab6670f7e5c96bfea Jun 14 19:18:36.663347 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:36.663309 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4" event={"ID":"a2e22ab4-3850-4359-9c6d-74dd303766c0","Type":"ContainerStarted","Data":"e16ead5f135ed3d781e3a73f17c1998df11d9b2599cec55ab6670f7e5c96bfea"} Jun 14 19:18:37.395338 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:37.395299 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:37.446294 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:37.446249 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:38.673648 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:38.673614 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4" event={"ID":"a2e22ab4-3850-4359-9c6d-74dd303766c0","Type":"ContainerStarted","Data":"69ec688406018497ce12c59c8badcf112d15b14e18fe57d32837c760f20f0860"} Jun 14 19:18:38.691930 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:38.691885 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j4kj4" podStartSLOduration=1.6569798690000002 podStartE2EDuration="3.691866003s" totalImagesPullingTime="2.034886134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:18:38.691062837 +0000 UTC m=+417.901993816" watchObservedRunningTime="2026-06-14 19:18:38.691866003 +0000 UTC m=+417.902796960" Jun 14 19:18:39.090062 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.090007 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:39.203461 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.203428 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:39.300584 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.300544 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:39.817158 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.817123 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz"] Jun 14 19:18:39.819347 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.819330 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:39.821458 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.821431 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 19:18:39.821806 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.821785 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f4nrq\"" Jun 14 19:18:39.821908 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.821820 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 19:18:39.831418 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.831384 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz"] Jun 14 19:18:39.920273 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.920214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:39.920524 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.920312 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25hdl\" (UniqueName: \"kubernetes.io/projected/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-kube-api-access-25hdl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:39.920524 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:39.920396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:40.021242 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.021183 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:40.021409 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.021263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25hdl\" (UniqueName: \"kubernetes.io/projected/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-kube-api-access-25hdl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:40.021409 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.021321 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:40.021636 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.021595 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:40.021698 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.021663 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:40.031561 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.031541 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25hdl\" (UniqueName: \"kubernetes.io/projected/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-kube-api-access-25hdl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:40.133447 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.133373 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:40.258924 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.258895 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz"] Jun 14 19:18:40.261044 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:18:40.261016 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4ba399_0831_4aa5_9d2b_a0d6fd6d1fd1.slice/crio-4d37a8e9454a2dca73debcecada270e3e4ca0312862b00960bcf02534d4c2aa8 WatchSource:0}: Error finding container 4d37a8e9454a2dca73debcecada270e3e4ca0312862b00960bcf02534d4c2aa8: Status 404 returned error can't find the container with id 4d37a8e9454a2dca73debcecada270e3e4ca0312862b00960bcf02534d4c2aa8 Jun 14 19:18:40.681869 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.681835 2559 generic.go:356] "Generic (PLEG): container finished" podID="3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" containerID="3ca4ce7434bb6582372f2e50dfcf56c6619f80dccb0daa1c4c31c0ed3775123b" exitCode=0 Jun 14 19:18:40.682040 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.681925 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" event={"ID":"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1","Type":"ContainerDied","Data":"3ca4ce7434bb6582372f2e50dfcf56c6619f80dccb0daa1c4c31c0ed3775123b"} Jun 14 19:18:40.682040 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.681974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" event={"ID":"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1","Type":"ContainerStarted","Data":"4d37a8e9454a2dca73debcecada270e3e4ca0312862b00960bcf02534d4c2aa8"} Jun 14 19:18:40.788425 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.788392 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-4zh98"] Jun 14 19:18:40.790495 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.790481 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" Jun 14 19:18:40.792544 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.792523 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 19:18:40.792636 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.792624 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ckwdg\"" Jun 14 19:18:40.792681 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.792647 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 19:18:40.798968 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.798944 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-4zh98"] Jun 14 19:18:40.931393 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.931358 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/786256d6-fbc8-4f96-8c63-a79b89986f2a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-4zh98\" (UID: \"786256d6-fbc8-4f96-8c63-a79b89986f2a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" Jun 14 19:18:40.931777 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:40.931426 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh2tb\" (UniqueName: \"kubernetes.io/projected/786256d6-fbc8-4f96-8c63-a79b89986f2a-kube-api-access-lh2tb\") pod \"cert-manager-webhook-7dc76cbb94-4zh98\" (UID: \"786256d6-fbc8-4f96-8c63-a79b89986f2a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" Jun 14 19:18:41.032069 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:41.031985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/786256d6-fbc8-4f96-8c63-a79b89986f2a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-4zh98\" (UID: \"786256d6-fbc8-4f96-8c63-a79b89986f2a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" Jun 14 19:18:41.032069 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:41.032050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh2tb\" (UniqueName: \"kubernetes.io/projected/786256d6-fbc8-4f96-8c63-a79b89986f2a-kube-api-access-lh2tb\") pod \"cert-manager-webhook-7dc76cbb94-4zh98\" (UID: \"786256d6-fbc8-4f96-8c63-a79b89986f2a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" Jun 14 19:18:41.039824 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:41.039796 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/786256d6-fbc8-4f96-8c63-a79b89986f2a-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-4zh98\" (UID: \"786256d6-fbc8-4f96-8c63-a79b89986f2a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" Jun 14 19:18:41.040096 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:41.040073 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh2tb\" (UniqueName: \"kubernetes.io/projected/786256d6-fbc8-4f96-8c63-a79b89986f2a-kube-api-access-lh2tb\") pod \"cert-manager-webhook-7dc76cbb94-4zh98\" (UID: \"786256d6-fbc8-4f96-8c63-a79b89986f2a\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" Jun 14 19:18:41.113737 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:41.113684 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" Jun 14 19:18:41.237936 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:41.237791 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-4zh98"] Jun 14 19:18:41.240290 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:18:41.240260 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod786256d6_fbc8_4f96_8c63_a79b89986f2a.slice/crio-4ae765d9e5cec57ae0a1704713c240ec64dfc596955a292ba3c2effc4356cc1d WatchSource:0}: Error finding container 4ae765d9e5cec57ae0a1704713c240ec64dfc596955a292ba3c2effc4356cc1d: Status 404 returned error can't find the container with id 4ae765d9e5cec57ae0a1704713c240ec64dfc596955a292ba3c2effc4356cc1d Jun 14 19:18:41.688848 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:41.688805 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" event={"ID":"786256d6-fbc8-4f96-8c63-a79b89986f2a","Type":"ContainerStarted","Data":"4ae765d9e5cec57ae0a1704713c240ec64dfc596955a292ba3c2effc4356cc1d"} Jun 14 19:18:42.837706 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:42.837670 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:43.033887 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:43.033849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:43.701722 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:43.701687 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" event={"ID":"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1","Type":"ContainerStarted","Data":"ab64a9ae7a345d72f29fbddc2adcd44065ff0c9dc8648138cf7d039342784e59"} Jun 14 19:18:43.703451 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:43.703419 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" event={"ID":"786256d6-fbc8-4f96-8c63-a79b89986f2a","Type":"ContainerStarted","Data":"5a4183fa11e29cbad5c06523ef428ca29d648ff50aa847a05435e80865092d40"} Jun 14 19:18:43.703604 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:43.703497 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" Jun 14 19:18:43.731299 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:43.731253 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" podStartSLOduration=1.375806429 podStartE2EDuration="3.731238761s" totalImagesPullingTime="2.355432332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:18:43.730782499 +0000 UTC m=+422.941713459" watchObservedRunningTime="2026-06-14 19:18:43.731238761 +0000 UTC m=+422.942169720" Jun 14 19:18:44.193654 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.193621 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:44.256407 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.256372 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:44.346683 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.346650 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9"] Jun 14 19:18:44.348852 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.348835 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9" Jun 14 19:18:44.350836 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.350812 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-j84dh\"" Jun 14 19:18:44.356503 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.356477 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9"] Jun 14 19:18:44.461468 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.461378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrgr2\" (UniqueName: \"kubernetes.io/projected/9c0d0bcb-d2bd-48df-81bb-452051b60c30-kube-api-access-xrgr2\") pod \"cert-manager-cainjector-5d99449ffd-mhrt9\" (UID: \"9c0d0bcb-d2bd-48df-81bb-452051b60c30\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9" Jun 14 19:18:44.461468 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.461421 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c0d0bcb-d2bd-48df-81bb-452051b60c30-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mhrt9\" (UID: \"9c0d0bcb-d2bd-48df-81bb-452051b60c30\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9" Jun 14 19:18:44.562048 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.562012 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrgr2\" (UniqueName: \"kubernetes.io/projected/9c0d0bcb-d2bd-48df-81bb-452051b60c30-kube-api-access-xrgr2\") pod \"cert-manager-cainjector-5d99449ffd-mhrt9\" (UID: \"9c0d0bcb-d2bd-48df-81bb-452051b60c30\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9" Jun 14 19:18:44.562048 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.562050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c0d0bcb-d2bd-48df-81bb-452051b60c30-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mhrt9\" (UID: \"9c0d0bcb-d2bd-48df-81bb-452051b60c30\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9" Jun 14 19:18:44.570495 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.570472 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c0d0bcb-d2bd-48df-81bb-452051b60c30-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mhrt9\" (UID: \"9c0d0bcb-d2bd-48df-81bb-452051b60c30\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9" Jun 14 19:18:44.570670 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.570654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrgr2\" (UniqueName: \"kubernetes.io/projected/9c0d0bcb-d2bd-48df-81bb-452051b60c30-kube-api-access-xrgr2\") pod \"cert-manager-cainjector-5d99449ffd-mhrt9\" (UID: \"9c0d0bcb-d2bd-48df-81bb-452051b60c30\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9" Jun 14 19:18:44.658150 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.658112 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9" Jun 14 19:18:44.713432 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.713359 2559 generic.go:356] "Generic (PLEG): container finished" podID="3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" containerID="ab64a9ae7a345d72f29fbddc2adcd44065ff0c9dc8648138cf7d039342784e59" exitCode=0 Jun 14 19:18:44.713568 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.713441 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" event={"ID":"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1","Type":"ContainerDied","Data":"ab64a9ae7a345d72f29fbddc2adcd44065ff0c9dc8648138cf7d039342784e59"} Jun 14 19:18:44.792926 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:44.792885 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9"] Jun 14 19:18:44.796103 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:18:44.796060 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c0d0bcb_d2bd_48df_81bb_452051b60c30.slice/crio-67fdf6e3853eabede88e23ee67c88fb257c380bb0aa172f5e7da4b23abead011 WatchSource:0}: Error finding container 67fdf6e3853eabede88e23ee67c88fb257c380bb0aa172f5e7da4b23abead011: Status 404 returned error can't find the container with id 67fdf6e3853eabede88e23ee67c88fb257c380bb0aa172f5e7da4b23abead011 Jun 14 19:18:45.719247 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:45.719190 2559 generic.go:356] "Generic (PLEG): container finished" podID="3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" containerID="6742b6630451f540cb67b1c75e5b274939944738be277ef37adccf4b293cfbef" exitCode=0 Jun 14 19:18:45.719623 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:45.719280 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" event={"ID":"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1","Type":"ContainerDied","Data":"6742b6630451f540cb67b1c75e5b274939944738be277ef37adccf4b293cfbef"} Jun 14 19:18:45.720849 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:45.720827 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9" event={"ID":"9c0d0bcb-d2bd-48df-81bb-452051b60c30","Type":"ContainerStarted","Data":"8a442d052cc37a5ac81876413fb5fbd64c37df3fb39e9186629a40be3a6eeb59"} Jun 14 19:18:45.720966 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:45.720856 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9" event={"ID":"9c0d0bcb-d2bd-48df-81bb-452051b60c30","Type":"ContainerStarted","Data":"67fdf6e3853eabede88e23ee67c88fb257c380bb0aa172f5e7da4b23abead011"} Jun 14 19:18:45.749480 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:45.749430 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mhrt9" podStartSLOduration=1.749411726 podStartE2EDuration="1.749411726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:18:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:18:45.749064459 +0000 UTC m=+424.959995458" watchObservedRunningTime="2026-06-14 19:18:45.749411726 +0000 UTC m=+424.960342696" Jun 14 19:18:46.847840 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:46.847816 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:46.985259 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:46.985151 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25hdl\" (UniqueName: \"kubernetes.io/projected/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-kube-api-access-25hdl\") pod \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " Jun 14 19:18:46.985259 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:46.985210 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-bundle\") pod \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " Jun 14 19:18:46.985481 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:46.985291 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-util\") pod \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\" (UID: \"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1\") " Jun 14 19:18:46.985646 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:46.985615 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-bundle" (OuterVolumeSpecName: "bundle") pod "3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" (UID: "3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:18:46.987507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:46.987478 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-kube-api-access-25hdl" (OuterVolumeSpecName: "kube-api-access-25hdl") pod "3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" (UID: "3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1"). InnerVolumeSpecName "kube-api-access-25hdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:18:46.990369 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:46.990341 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-util" (OuterVolumeSpecName: "util") pod "3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" (UID: "3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:18:47.086186 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:47.086153 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:18:47.086186 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:47.086180 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-util\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:18:47.086186 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:47.086190 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25hdl\" (UniqueName: \"kubernetes.io/projected/3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1-kube-api-access-25hdl\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:18:47.730306 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:47.730274 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" event={"ID":"3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1","Type":"ContainerDied","Data":"4d37a8e9454a2dca73debcecada270e3e4ca0312862b00960bcf02534d4c2aa8"} Jun 14 19:18:47.730467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:47.730316 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjfcgz" Jun 14 19:18:47.730467 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:47.730321 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d37a8e9454a2dca73debcecada270e3e4ca0312862b00960bcf02534d4c2aa8" Jun 14 19:18:49.715974 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:49.715943 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4zh98" Jun 14 19:18:49.838647 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:49.838614 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:51.858562 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:51.858530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:51.955515 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:51.955486 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:53.490188 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.490152 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp"] Jun 14 19:18:53.490569 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.490433 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" containerName="pull" Jun 14 19:18:53.490569 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.490444 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" containerName="pull" Jun 14 19:18:53.490569 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.490461 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" containerName="extract" Jun 14 19:18:53.490569 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.490466 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" containerName="extract" Jun 14 19:18:53.490569 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.490475 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" containerName="util" Jun 14 19:18:53.490569 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.490480 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" containerName="util" Jun 14 19:18:53.490569 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.490527 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a4ba399-0831-4aa5-9d2b-a0d6fd6d1fd1" containerName="extract" Jun 14 19:18:53.492395 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.492378 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp" Jun 14 19:18:53.494588 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.494558 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 19:18:53.495094 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.495078 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 19:18:53.495173 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.495122 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-n9cgd\"" Jun 14 19:18:53.503079 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.503057 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp"] Jun 14 19:18:53.639732 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.639686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9fqw\" (UniqueName: \"kubernetes.io/projected/807a089e-5ab6-4cf0-91da-8bdb862228e3-kube-api-access-s9fqw\") pod \"openshift-lws-operator-fd8ccff4c-8pcnp\" (UID: \"807a089e-5ab6-4cf0-91da-8bdb862228e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp" Jun 14 19:18:53.639877 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.639742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/807a089e-5ab6-4cf0-91da-8bdb862228e3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8pcnp\" (UID: \"807a089e-5ab6-4cf0-91da-8bdb862228e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp" Jun 14 19:18:53.740911 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.740831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9fqw\" (UniqueName: \"kubernetes.io/projected/807a089e-5ab6-4cf0-91da-8bdb862228e3-kube-api-access-s9fqw\") pod \"openshift-lws-operator-fd8ccff4c-8pcnp\" (UID: \"807a089e-5ab6-4cf0-91da-8bdb862228e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp" Jun 14 19:18:53.740911 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.740876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/807a089e-5ab6-4cf0-91da-8bdb862228e3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8pcnp\" (UID: \"807a089e-5ab6-4cf0-91da-8bdb862228e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp" Jun 14 19:18:53.741208 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.741193 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/807a089e-5ab6-4cf0-91da-8bdb862228e3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8pcnp\" (UID: \"807a089e-5ab6-4cf0-91da-8bdb862228e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp" Jun 14 19:18:53.748220 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.748189 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9fqw\" (UniqueName: \"kubernetes.io/projected/807a089e-5ab6-4cf0-91da-8bdb862228e3-kube-api-access-s9fqw\") pod \"openshift-lws-operator-fd8ccff4c-8pcnp\" (UID: \"807a089e-5ab6-4cf0-91da-8bdb862228e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp" Jun 14 19:18:53.800930 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.800900 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp" Jun 14 19:18:53.923603 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:53.923569 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp"] Jun 14 19:18:53.926591 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:18:53.926563 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod807a089e_5ab6_4cf0_91da_8bdb862228e3.slice/crio-c3211b5da3c5f3b840e38e8f91f8fb5947da82760a4f632416b754d3cd10d4f1 WatchSource:0}: Error finding container c3211b5da3c5f3b840e38e8f91f8fb5947da82760a4f632416b754d3cd10d4f1: Status 404 returned error can't find the container with id c3211b5da3c5f3b840e38e8f91f8fb5947da82760a4f632416b754d3cd10d4f1 Jun 14 19:18:54.760507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:54.760418 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp" event={"ID":"807a089e-5ab6-4cf0-91da-8bdb862228e3","Type":"ContainerStarted","Data":"c3211b5da3c5f3b840e38e8f91f8fb5947da82760a4f632416b754d3cd10d4f1"} Jun 14 19:18:55.766883 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:55.766848 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp" event={"ID":"807a089e-5ab6-4cf0-91da-8bdb862228e3","Type":"ContainerStarted","Data":"17df0b9fdb45b0c116b6ab27d4efd30dbd676e3203b40abd7e2863a866bcebdb"} Jun 14 19:18:55.781629 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:55.781581 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8pcnp" podStartSLOduration=1.17365235 podStartE2EDuration="2.781568248s" totalImagesPullingTime="1.607915898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:18:55.780301987 +0000 UTC m=+434.991232940" watchObservedRunningTime="2026-06-14 19:18:55.781568248 +0000 UTC m=+434.992499205" Jun 14 19:18:56.430931 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:56.430898 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:56.532876 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:56.532839 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:58.073772 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.073738 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx"] Jun 14 19:18:58.075901 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.075879 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:18:58.077761 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.077741 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 19:18:58.078397 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.078379 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f4nrq\"" Jun 14 19:18:58.078474 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.078379 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 19:18:58.083555 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.083531 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx"] Jun 14 19:18:58.176416 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.176378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:18:58.176575 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.176430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:18:58.176575 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.176520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xppd8\" (UniqueName: \"kubernetes.io/projected/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-kube-api-access-xppd8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:18:58.277535 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.277508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:18:58.277671 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.277547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:18:58.277671 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.277585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xppd8\" (UniqueName: \"kubernetes.io/projected/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-kube-api-access-xppd8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:18:58.277891 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.277871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:18:58.277954 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.277911 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:18:58.286794 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.286774 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xppd8\" (UniqueName: \"kubernetes.io/projected/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-kube-api-access-xppd8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:18:58.385910 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.385824 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:18:58.488724 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.488580 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:18:58.516655 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.516633 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx"] Jun 14 19:18:58.519117 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:18:58.519093 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ed83a9_18bd_48a5_8f98_d93aad4397c9.slice/crio-82bb3770400d9b7675040d59ffdb129cc9c3889cfdfbc4c130ddcc1dbd2ae0f6 WatchSource:0}: Error finding container 82bb3770400d9b7675040d59ffdb129cc9c3889cfdfbc4c130ddcc1dbd2ae0f6: Status 404 returned error can't find the container with id 82bb3770400d9b7675040d59ffdb129cc9c3889cfdfbc4c130ddcc1dbd2ae0f6 Jun 14 19:18:58.779483 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.779404 2559 generic.go:356] "Generic (PLEG): container finished" podID="e4ed83a9-18bd-48a5-8f98-d93aad4397c9" containerID="4cb1840b6aee0cb4edba686717c27f462f96055f4dbac6005b01a7267fa0167f" exitCode=0 Jun 14 19:18:58.779624 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.779487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" event={"ID":"e4ed83a9-18bd-48a5-8f98-d93aad4397c9","Type":"ContainerDied","Data":"4cb1840b6aee0cb4edba686717c27f462f96055f4dbac6005b01a7267fa0167f"} Jun 14 19:18:58.779624 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:58.779532 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" event={"ID":"e4ed83a9-18bd-48a5-8f98-d93aad4397c9","Type":"ContainerStarted","Data":"82bb3770400d9b7675040d59ffdb129cc9c3889cfdfbc4c130ddcc1dbd2ae0f6"} Jun 14 19:18:59.785271 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:59.785210 2559 generic.go:356] "Generic (PLEG): container finished" podID="e4ed83a9-18bd-48a5-8f98-d93aad4397c9" containerID="74704258e2fe929a4e0921ca4c6f2cd8702dce783b673cea20edac3244f71472" exitCode=0 Jun 14 19:18:59.785640 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:18:59.785325 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" event={"ID":"e4ed83a9-18bd-48a5-8f98-d93aad4397c9","Type":"ContainerDied","Data":"74704258e2fe929a4e0921ca4c6f2cd8702dce783b673cea20edac3244f71472"} Jun 14 19:19:00.792181 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:00.792148 2559 generic.go:356] "Generic (PLEG): container finished" podID="e4ed83a9-18bd-48a5-8f98-d93aad4397c9" containerID="d5ad08db155772e51ecdc4369dbc495eb7a50bbbed5c78718192217681938ffa" exitCode=0 Jun 14 19:19:00.792602 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:00.792255 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" event={"ID":"e4ed83a9-18bd-48a5-8f98-d93aad4397c9","Type":"ContainerDied","Data":"d5ad08db155772e51ecdc4369dbc495eb7a50bbbed5c78718192217681938ffa"} Jun 14 19:19:01.919878 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:01.919856 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:19:02.108266 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.108166 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-util\") pod \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " Jun 14 19:19:02.108266 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.108239 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-bundle\") pod \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " Jun 14 19:19:02.108266 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.108265 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xppd8\" (UniqueName: \"kubernetes.io/projected/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-kube-api-access-xppd8\") pod \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\" (UID: \"e4ed83a9-18bd-48a5-8f98-d93aad4397c9\") " Jun 14 19:19:02.109048 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.109011 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-bundle" (OuterVolumeSpecName: "bundle") pod "e4ed83a9-18bd-48a5-8f98-d93aad4397c9" (UID: "e4ed83a9-18bd-48a5-8f98-d93aad4397c9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:19:02.110334 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.110310 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-kube-api-access-xppd8" (OuterVolumeSpecName: "kube-api-access-xppd8") pod "e4ed83a9-18bd-48a5-8f98-d93aad4397c9" (UID: "e4ed83a9-18bd-48a5-8f98-d93aad4397c9"). InnerVolumeSpecName "kube-api-access-xppd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:19:02.113858 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.113827 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-util" (OuterVolumeSpecName: "util") pod "e4ed83a9-18bd-48a5-8f98-d93aad4397c9" (UID: "e4ed83a9-18bd-48a5-8f98-d93aad4397c9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:19:02.209130 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.209096 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xppd8\" (UniqueName: \"kubernetes.io/projected/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-kube-api-access-xppd8\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:19:02.209130 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.209125 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-util\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:19:02.209130 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.209134 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4ed83a9-18bd-48a5-8f98-d93aad4397c9-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:19:02.750806 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.750768 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:02.805072 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.805031 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" event={"ID":"e4ed83a9-18bd-48a5-8f98-d93aad4397c9","Type":"ContainerDied","Data":"82bb3770400d9b7675040d59ffdb129cc9c3889cfdfbc4c130ddcc1dbd2ae0f6"} Jun 14 19:19:02.805072 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.805064 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmtjkx" Jun 14 19:19:02.805293 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.805112 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82bb3770400d9b7675040d59ffdb129cc9c3889cfdfbc4c130ddcc1dbd2ae0f6" Jun 14 19:19:02.813400 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:02.813377 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:12.031257 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:12.031206 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:12.156159 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:12.156125 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:12.631704 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:12.631672 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:12.867513 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:12.867483 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:12.960375 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:12.960292 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:13.018705 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.018674 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9"] Jun 14 19:19:13.018954 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.018942 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4ed83a9-18bd-48a5-8f98-d93aad4397c9" containerName="extract" Jun 14 19:19:13.018998 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.018955 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ed83a9-18bd-48a5-8f98-d93aad4397c9" containerName="extract" Jun 14 19:19:13.018998 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.018965 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4ed83a9-18bd-48a5-8f98-d93aad4397c9" containerName="pull" Jun 14 19:19:13.018998 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.018970 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ed83a9-18bd-48a5-8f98-d93aad4397c9" containerName="pull" Jun 14 19:19:13.018998 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.018977 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4ed83a9-18bd-48a5-8f98-d93aad4397c9" containerName="util" Jun 14 19:19:13.018998 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.018983 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ed83a9-18bd-48a5-8f98-d93aad4397c9" containerName="util" Jun 14 19:19:13.019150 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.019026 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4ed83a9-18bd-48a5-8f98-d93aad4397c9" containerName="extract" Jun 14 19:19:13.021542 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.021523 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.025423 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.025404 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 19:19:13.026701 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.026682 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 19:19:13.026782 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.026690 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 19:19:13.026782 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.026737 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 19:19:13.026972 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.026957 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ltfm9\"" Jun 14 19:19:13.058999 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.058975 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9"] Jun 14 19:19:13.088660 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.088627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.088822 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.088688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjvbc\" (UniqueName: \"kubernetes.io/projected/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-kube-api-access-zjvbc\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.088873 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.088827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-manifests\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.088921 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.088868 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-tmp\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.088921 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.088896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.190096 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.190063 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-manifests\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.190096 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.190099 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-tmp\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.190350 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.190125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.190350 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.190161 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.190350 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.190200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjvbc\" (UniqueName: \"kubernetes.io/projected/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-kube-api-access-zjvbc\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.190537 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.190510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-manifests\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.192505 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.192476 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-tmp\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.192598 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.192548 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.192637 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.192606 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.195887 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.195867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:13.198316 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.198295 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjvbc\" (UniqueName: \"kubernetes.io/projected/466c47e2-9f8e-42ff-bd89-759e7bfe83f8-kube-api-access-zjvbc\") pod \"opendatahub-operator-controller-manager-7f8bf57587-sf8n9\" (UID: \"466c47e2-9f8e-42ff-bd89-759e7bfe83f8\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.304896 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.304866 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:13.331886 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.331860 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:13.397025 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.396974 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:13.470278 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.470254 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9"] Jun 14 19:19:13.472832 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:19:13.472802 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466c47e2_9f8e_42ff_bd89_759e7bfe83f8.slice/crio-9b321cdb5c92278a00d720da61bd8f397bedf0c35e751bfc92dd5c5cc215ff3b WatchSource:0}: Error finding container 9b321cdb5c92278a00d720da61bd8f397bedf0c35e751bfc92dd5c5cc215ff3b: Status 404 returned error can't find the container with id 9b321cdb5c92278a00d720da61bd8f397bedf0c35e751bfc92dd5c5cc215ff3b Jun 14 19:19:13.476027 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.475993 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:13.533379 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.533331 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:13.638660 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.638568 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:13.735165 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.735100 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:13.851497 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:13.851466 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" event={"ID":"466c47e2-9f8e-42ff-bd89-759e7bfe83f8","Type":"ContainerStarted","Data":"9b321cdb5c92278a00d720da61bd8f397bedf0c35e751bfc92dd5c5cc215ff3b"} Jun 14 19:19:16.867922 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:16.867877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" event={"ID":"466c47e2-9f8e-42ff-bd89-759e7bfe83f8","Type":"ContainerStarted","Data":"6dfbb30837789991004091852518aa4271e6053a679c8fe74abf80ea3ff747f6"} Jun 14 19:19:17.873605 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:17.873573 2559 generic.go:356] "Generic (PLEG): container finished" podID="466c47e2-9f8e-42ff-bd89-759e7bfe83f8" containerID="6dfbb30837789991004091852518aa4271e6053a679c8fe74abf80ea3ff747f6" exitCode=0 Jun 14 19:19:17.874093 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:17.873610 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" event={"ID":"466c47e2-9f8e-42ff-bd89-759e7bfe83f8","Type":"ContainerDied","Data":"6dfbb30837789991004091852518aa4271e6053a679c8fe74abf80ea3ff747f6"} Jun 14 19:19:18.879586 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:18.879546 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" event={"ID":"466c47e2-9f8e-42ff-bd89-759e7bfe83f8","Type":"ContainerStarted","Data":"b216be360e916b37b93cc77499b874febc04469eef718b4e82cb3e5e8ce2ece9"} Jun 14 19:19:18.880032 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:18.879681 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:18.899439 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:18.899395 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" podStartSLOduration=2.57478967 podStartE2EDuration="6.899382191s" totalImagesPullingTime="3.339913495s" totalInitContainerRuntime="984.679026ms" isStatefulPod=false podCreationTimestamp="2026-06-14 19:19:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:19:18.897485892 +0000 UTC m=+458.108416863" watchObservedRunningTime="2026-06-14 19:19:18.899382191 +0000 UTC m=+458.110313183" Jun 14 19:19:20.757944 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:20.757917 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:20.857591 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:20.857539 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:24.639308 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:24.639271 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:24.733169 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:24.733114 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:29.886877 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:29.886840 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8bf57587-sf8n9" Jun 14 19:19:31.991555 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:31.991525 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:32.094393 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.094366 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:32.716502 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.716470 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-2px2r"] Jun 14 19:19:32.720200 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.720183 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" Jun 14 19:19:32.724136 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.724116 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 14 19:19:32.724280 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.724123 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7g6c6\"" Jun 14 19:19:32.743794 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.743379 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-2px2r"] Jun 14 19:19:32.787466 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.787437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:32.844762 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.844732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61906e53-442c-4c8d-a0de-99ad9ed3c34f-cert\") pod \"odh-model-controller-6dc94f689f-2px2r\" (UID: \"61906e53-442c-4c8d-a0de-99ad9ed3c34f\") " pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" Jun 14 19:19:32.844897 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.844768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbbnh\" (UniqueName: \"kubernetes.io/projected/61906e53-442c-4c8d-a0de-99ad9ed3c34f-kube-api-access-fbbnh\") pod \"odh-model-controller-6dc94f689f-2px2r\" (UID: \"61906e53-442c-4c8d-a0de-99ad9ed3c34f\") " pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" Jun 14 19:19:32.885899 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.885869 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:32.945507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.945480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61906e53-442c-4c8d-a0de-99ad9ed3c34f-cert\") pod \"odh-model-controller-6dc94f689f-2px2r\" (UID: \"61906e53-442c-4c8d-a0de-99ad9ed3c34f\") " pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" Jun 14 19:19:32.945649 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.945518 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbbnh\" (UniqueName: \"kubernetes.io/projected/61906e53-442c-4c8d-a0de-99ad9ed3c34f-kube-api-access-fbbnh\") pod \"odh-model-controller-6dc94f689f-2px2r\" (UID: \"61906e53-442c-4c8d-a0de-99ad9ed3c34f\") " pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" Jun 14 19:19:32.945649 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:19:32.945630 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 14 19:19:32.945733 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:19:32.945703 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61906e53-442c-4c8d-a0de-99ad9ed3c34f-cert podName:61906e53-442c-4c8d-a0de-99ad9ed3c34f nodeName:}" failed. No retries permitted until 2026-06-14 19:19:33.445683705 +0000 UTC m=+472.656614661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/61906e53-442c-4c8d-a0de-99ad9ed3c34f-cert") pod "odh-model-controller-6dc94f689f-2px2r" (UID: "61906e53-442c-4c8d-a0de-99ad9ed3c34f") : secret "odh-model-controller-webhook-cert" not found Jun 14 19:19:32.961401 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.961377 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbbnh\" (UniqueName: \"kubernetes.io/projected/61906e53-442c-4c8d-a0de-99ad9ed3c34f-kube-api-access-fbbnh\") pod \"odh-model-controller-6dc94f689f-2px2r\" (UID: \"61906e53-442c-4c8d-a0de-99ad9ed3c34f\") " pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" Jun 14 19:19:32.989796 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:32.989684 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:33.196537 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.196500 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:33.301889 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.301862 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-rd67z"] Jun 14 19:19:33.305787 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.305769 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-rd67z" Jun 14 19:19:33.308396 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.308377 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 14 19:19:33.321792 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.321766 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-rd67z"] Jun 14 19:19:33.341816 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.341789 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:33.348892 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.348865 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1331503c-8b0c-4b66-acf3-6fa3a4f6cae9-tls-certs\") pod \"model-serving-api-5dd488fc48-rd67z\" (UID: \"1331503c-8b0c-4b66-acf3-6fa3a4f6cae9\") " pod="opendatahub/model-serving-api-5dd488fc48-rd67z" Jun 14 19:19:33.348983 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.348893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p52z7\" (UniqueName: \"kubernetes.io/projected/1331503c-8b0c-4b66-acf3-6fa3a4f6cae9-kube-api-access-p52z7\") pod \"model-serving-api-5dd488fc48-rd67z\" (UID: \"1331503c-8b0c-4b66-acf3-6fa3a4f6cae9\") " pod="opendatahub/model-serving-api-5dd488fc48-rd67z" Jun 14 19:19:33.435549 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.435509 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:33.449689 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.449666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1331503c-8b0c-4b66-acf3-6fa3a4f6cae9-tls-certs\") pod \"model-serving-api-5dd488fc48-rd67z\" (UID: \"1331503c-8b0c-4b66-acf3-6fa3a4f6cae9\") " pod="opendatahub/model-serving-api-5dd488fc48-rd67z" Jun 14 19:19:33.449801 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.449695 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p52z7\" (UniqueName: \"kubernetes.io/projected/1331503c-8b0c-4b66-acf3-6fa3a4f6cae9-kube-api-access-p52z7\") pod \"model-serving-api-5dd488fc48-rd67z\" (UID: \"1331503c-8b0c-4b66-acf3-6fa3a4f6cae9\") " pod="opendatahub/model-serving-api-5dd488fc48-rd67z" Jun 14 19:19:33.449801 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.449734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61906e53-442c-4c8d-a0de-99ad9ed3c34f-cert\") pod \"odh-model-controller-6dc94f689f-2px2r\" (UID: \"61906e53-442c-4c8d-a0de-99ad9ed3c34f\") " pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" Jun 14 19:19:33.452321 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.452298 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1331503c-8b0c-4b66-acf3-6fa3a4f6cae9-tls-certs\") pod \"model-serving-api-5dd488fc48-rd67z\" (UID: \"1331503c-8b0c-4b66-acf3-6fa3a4f6cae9\") " pod="opendatahub/model-serving-api-5dd488fc48-rd67z" Jun 14 19:19:33.452422 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.452306 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61906e53-442c-4c8d-a0de-99ad9ed3c34f-cert\") pod \"odh-model-controller-6dc94f689f-2px2r\" (UID: \"61906e53-442c-4c8d-a0de-99ad9ed3c34f\") " pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" Jun 14 19:19:33.456591 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.456567 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p52z7\" (UniqueName: \"kubernetes.io/projected/1331503c-8b0c-4b66-acf3-6fa3a4f6cae9-kube-api-access-p52z7\") pod \"model-serving-api-5dd488fc48-rd67z\" (UID: \"1331503c-8b0c-4b66-acf3-6fa3a4f6cae9\") " pod="opendatahub/model-serving-api-5dd488fc48-rd67z" Jun 14 19:19:33.616536 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.616451 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-rd67z" Jun 14 19:19:33.630344 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.630300 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" Jun 14 19:19:33.752124 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.752097 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-rd67z"] Jun 14 19:19:33.754481 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:19:33.754450 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1331503c_8b0c_4b66_acf3_6fa3a4f6cae9.slice/crio-4aa29fe0e690549aad6a79b72ed77f4d6f3c39c140916e249a0bb25dfebd6c86 WatchSource:0}: Error finding container 4aa29fe0e690549aad6a79b72ed77f4d6f3c39c140916e249a0bb25dfebd6c86: Status 404 returned error can't find the container with id 4aa29fe0e690549aad6a79b72ed77f4d6f3c39c140916e249a0bb25dfebd6c86 Jun 14 19:19:33.775946 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.775924 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-2px2r"] Jun 14 19:19:33.778199 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:19:33.778172 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61906e53_442c_4c8d_a0de_99ad9ed3c34f.slice/crio-906b9f91580a18b83fabf9557f07f42504c52352a8f4caff395742900f858ad9 WatchSource:0}: Error finding container 906b9f91580a18b83fabf9557f07f42504c52352a8f4caff395742900f858ad9: Status 404 returned error can't find the container with id 906b9f91580a18b83fabf9557f07f42504c52352a8f4caff395742900f858ad9 Jun 14 19:19:33.950577 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.950491 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" event={"ID":"61906e53-442c-4c8d-a0de-99ad9ed3c34f","Type":"ContainerStarted","Data":"906b9f91580a18b83fabf9557f07f42504c52352a8f4caff395742900f858ad9"} Jun 14 19:19:33.951717 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:33.951693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-rd67z" event={"ID":"1331503c-8b0c-4b66-acf3-6fa3a4f6cae9","Type":"ContainerStarted","Data":"4aa29fe0e690549aad6a79b72ed77f4d6f3c39c140916e249a0bb25dfebd6c86"} Jun 14 19:19:37.974415 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:37.974314 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" event={"ID":"61906e53-442c-4c8d-a0de-99ad9ed3c34f","Type":"ContainerStarted","Data":"159b386605f0d8eb03103849382d823b370e5dc4dd08ef17e920a9502c0140f2"} Jun 14 19:19:37.981150 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:37.975291 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" Jun 14 19:19:37.981150 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:37.978961 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-rd67z" event={"ID":"1331503c-8b0c-4b66-acf3-6fa3a4f6cae9","Type":"ContainerStarted","Data":"ff20faf4c4ebaec69d5c0795a4b89cfdd71fdce305f9a7ace4872487bd7fab65"} Jun 14 19:19:37.981150 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:37.979294 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-rd67z" Jun 14 19:19:37.991876 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:37.991828 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" podStartSLOduration=2.176130237 podStartE2EDuration="5.991815098s" totalImagesPullingTime="3.815684861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:19:37.99026792 +0000 UTC m=+477.201198891" watchObservedRunningTime="2026-06-14 19:19:37.991815098 +0000 UTC m=+477.202746078" Jun 14 19:19:38.006979 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:38.006927 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-rd67z" podStartSLOduration=1.12894597 podStartE2EDuration="5.00691332s" totalImagesPullingTime="3.87796735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:19:38.005153725 +0000 UTC m=+477.216084683" watchObservedRunningTime="2026-06-14 19:19:38.00691332 +0000 UTC m=+477.217844277" Jun 14 19:19:38.026841 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:38.026809 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:38.127904 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:38.127874 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:39.971896 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:39.971863 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:42.027405 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.027370 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:42.081150 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.081113 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-zgzbc"] Jun 14 19:19:42.085780 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.085760 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" Jun 14 19:19:42.088382 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.088357 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 14 19:19:42.088715 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.088691 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qbhtv\"" Jun 14 19:19:42.089986 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.089965 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h"] Jun 14 19:19:42.092922 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.092905 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" Jun 14 19:19:42.095066 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.095046 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4qfhk\"" Jun 14 19:19:42.095324 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.095304 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 14 19:19:42.097535 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.097511 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-zgzbc"] Jun 14 19:19:42.104584 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.104564 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h"] Jun 14 19:19:42.116959 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.116939 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:42.123125 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.123100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a435b7ed-4dc4-4390-b684-a3db72d42183-cert\") pod \"kserve-controller-manager-69fc866d76-zgzbc\" (UID: \"a435b7ed-4dc4-4390-b684-a3db72d42183\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" Jun 14 19:19:42.123240 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.123148 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h64zh\" (UniqueName: \"kubernetes.io/projected/a435b7ed-4dc4-4390-b684-a3db72d42183-kube-api-access-h64zh\") pod \"kserve-controller-manager-69fc866d76-zgzbc\" (UID: \"a435b7ed-4dc4-4390-b684-a3db72d42183\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" Jun 14 19:19:42.223933 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.223900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bntph\" (UniqueName: \"kubernetes.io/projected/925ea225-be08-4fb8-8999-63c236bd1fd8-kube-api-access-bntph\") pod \"llmisvc-controller-manager-864bfd7bc9-z5j4h\" (UID: \"925ea225-be08-4fb8-8999-63c236bd1fd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" Jun 14 19:19:42.224074 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.223950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a435b7ed-4dc4-4390-b684-a3db72d42183-cert\") pod \"kserve-controller-manager-69fc866d76-zgzbc\" (UID: \"a435b7ed-4dc4-4390-b684-a3db72d42183\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" Jun 14 19:19:42.224074 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.224026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h64zh\" (UniqueName: \"kubernetes.io/projected/a435b7ed-4dc4-4390-b684-a3db72d42183-kube-api-access-h64zh\") pod \"kserve-controller-manager-69fc866d76-zgzbc\" (UID: \"a435b7ed-4dc4-4390-b684-a3db72d42183\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" Jun 14 19:19:42.224168 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.224073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/925ea225-be08-4fb8-8999-63c236bd1fd8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-z5j4h\" (UID: \"925ea225-be08-4fb8-8999-63c236bd1fd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" Jun 14 19:19:42.226443 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.226415 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a435b7ed-4dc4-4390-b684-a3db72d42183-cert\") pod \"kserve-controller-manager-69fc866d76-zgzbc\" (UID: \"a435b7ed-4dc4-4390-b684-a3db72d42183\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" Jun 14 19:19:42.230901 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.230880 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:42.233272 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.233214 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h64zh\" (UniqueName: \"kubernetes.io/projected/a435b7ed-4dc4-4390-b684-a3db72d42183-kube-api-access-h64zh\") pod \"kserve-controller-manager-69fc866d76-zgzbc\" (UID: \"a435b7ed-4dc4-4390-b684-a3db72d42183\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" Jun 14 19:19:42.325139 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.325107 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bntph\" (UniqueName: \"kubernetes.io/projected/925ea225-be08-4fb8-8999-63c236bd1fd8-kube-api-access-bntph\") pod \"llmisvc-controller-manager-864bfd7bc9-z5j4h\" (UID: \"925ea225-be08-4fb8-8999-63c236bd1fd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" Jun 14 19:19:42.325316 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.325189 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/925ea225-be08-4fb8-8999-63c236bd1fd8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-z5j4h\" (UID: \"925ea225-be08-4fb8-8999-63c236bd1fd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" Jun 14 19:19:42.327590 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.327566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/925ea225-be08-4fb8-8999-63c236bd1fd8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-z5j4h\" (UID: \"925ea225-be08-4fb8-8999-63c236bd1fd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" Jun 14 19:19:42.338525 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.338495 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bntph\" (UniqueName: \"kubernetes.io/projected/925ea225-be08-4fb8-8999-63c236bd1fd8-kube-api-access-bntph\") pod \"llmisvc-controller-manager-864bfd7bc9-z5j4h\" (UID: \"925ea225-be08-4fb8-8999-63c236bd1fd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" Jun 14 19:19:42.382355 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.382331 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:42.398285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.398262 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" Jun 14 19:19:42.407337 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.407311 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" Jun 14 19:19:42.546064 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.546042 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-zgzbc"] Jun 14 19:19:42.548126 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:19:42.548100 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda435b7ed_4dc4_4390_b684_a3db72d42183.slice/crio-0f8dc63da3ea1c7ed0a3efb5d492d691ca5b58ee26bb84eb7595744ac9e400c7 WatchSource:0}: Error finding container 0f8dc63da3ea1c7ed0a3efb5d492d691ca5b58ee26bb84eb7595744ac9e400c7: Status 404 returned error can't find the container with id 0f8dc63da3ea1c7ed0a3efb5d492d691ca5b58ee26bb84eb7595744ac9e400c7 Jun 14 19:19:42.563876 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:42.563851 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h"] Jun 14 19:19:42.567132 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:19:42.567107 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod925ea225_be08_4fb8_8999_63c236bd1fd8.slice/crio-29cf6bec5d0ca144c6a7d6325b6f79e0ebe9f173873b49147cb9eb9b7018de6e WatchSource:0}: Error finding container 29cf6bec5d0ca144c6a7d6325b6f79e0ebe9f173873b49147cb9eb9b7018de6e: Status 404 returned error can't find the container with id 29cf6bec5d0ca144c6a7d6325b6f79e0ebe9f173873b49147cb9eb9b7018de6e Jun 14 19:19:43.005035 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.004997 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" event={"ID":"925ea225-be08-4fb8-8999-63c236bd1fd8","Type":"ContainerStarted","Data":"29cf6bec5d0ca144c6a7d6325b6f79e0ebe9f173873b49147cb9eb9b7018de6e"} Jun 14 19:19:43.006169 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.006142 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" event={"ID":"a435b7ed-4dc4-4390-b684-a3db72d42183","Type":"ContainerStarted","Data":"0f8dc63da3ea1c7ed0a3efb5d492d691ca5b58ee26bb84eb7595744ac9e400c7"} Jun 14 19:19:43.106579 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.106541 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:43.147573 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.147547 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-675778c988-zrbq8"] Jun 14 19:19:43.150975 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.150950 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:43.153167 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.153127 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 19:19:43.153167 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.153160 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 19:19:43.153376 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.153195 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cbttp\"" Jun 14 19:19:43.159489 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.159465 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-675778c988-zrbq8"] Jun 14 19:19:43.193963 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.193932 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:43.233791 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.233754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6760d320-1c9b-4248-a3b3-560a7f65bb7c-tmp\") pod \"kube-auth-proxy-675778c988-zrbq8\" (UID: \"6760d320-1c9b-4248-a3b3-560a7f65bb7c\") " pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:43.233939 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.233796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6760d320-1c9b-4248-a3b3-560a7f65bb7c-tls-certs\") pod \"kube-auth-proxy-675778c988-zrbq8\" (UID: \"6760d320-1c9b-4248-a3b3-560a7f65bb7c\") " pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:43.233939 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.233832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7jfz\" (UniqueName: \"kubernetes.io/projected/6760d320-1c9b-4248-a3b3-560a7f65bb7c-kube-api-access-t7jfz\") pod \"kube-auth-proxy-675778c988-zrbq8\" (UID: \"6760d320-1c9b-4248-a3b3-560a7f65bb7c\") " pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:43.335072 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.335042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6760d320-1c9b-4248-a3b3-560a7f65bb7c-tmp\") pod \"kube-auth-proxy-675778c988-zrbq8\" (UID: \"6760d320-1c9b-4248-a3b3-560a7f65bb7c\") " pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:43.335265 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.335087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6760d320-1c9b-4248-a3b3-560a7f65bb7c-tls-certs\") pod \"kube-auth-proxy-675778c988-zrbq8\" (UID: \"6760d320-1c9b-4248-a3b3-560a7f65bb7c\") " pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:43.335265 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:19:43.335196 2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 14 19:19:43.335391 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.335264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7jfz\" (UniqueName: \"kubernetes.io/projected/6760d320-1c9b-4248-a3b3-560a7f65bb7c-kube-api-access-t7jfz\") pod \"kube-auth-proxy-675778c988-zrbq8\" (UID: \"6760d320-1c9b-4248-a3b3-560a7f65bb7c\") " pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:43.335391 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:19:43.335283 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6760d320-1c9b-4248-a3b3-560a7f65bb7c-tls-certs podName:6760d320-1c9b-4248-a3b3-560a7f65bb7c nodeName:}" failed. No retries permitted until 2026-06-14 19:19:43.835259512 +0000 UTC m=+483.046190447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6760d320-1c9b-4248-a3b3-560a7f65bb7c-tls-certs") pod "kube-auth-proxy-675778c988-zrbq8" (UID: "6760d320-1c9b-4248-a3b3-560a7f65bb7c") : secret "kube-auth-proxy-tls" not found Jun 14 19:19:43.337497 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.337469 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6760d320-1c9b-4248-a3b3-560a7f65bb7c-tmp\") pod \"kube-auth-proxy-675778c988-zrbq8\" (UID: \"6760d320-1c9b-4248-a3b3-560a7f65bb7c\") " pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:43.343953 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.343927 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7jfz\" (UniqueName: \"kubernetes.io/projected/6760d320-1c9b-4248-a3b3-560a7f65bb7c-kube-api-access-t7jfz\") pod \"kube-auth-proxy-675778c988-zrbq8\" (UID: \"6760d320-1c9b-4248-a3b3-560a7f65bb7c\") " pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:43.442669 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.442630 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:43.596753 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.596675 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:43.699917 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.699873 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:43.799542 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.799508 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:43.840219 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.840174 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6760d320-1c9b-4248-a3b3-560a7f65bb7c-tls-certs\") pod \"kube-auth-proxy-675778c988-zrbq8\" (UID: \"6760d320-1c9b-4248-a3b3-560a7f65bb7c\") " pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:43.842783 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:43.842762 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6760d320-1c9b-4248-a3b3-560a7f65bb7c-tls-certs\") pod \"kube-auth-proxy-675778c988-zrbq8\" (UID: \"6760d320-1c9b-4248-a3b3-560a7f65bb7c\") " pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:44.064164 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:44.064125 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" Jun 14 19:19:44.210314 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:44.210278 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-675778c988-zrbq8"] Jun 14 19:19:44.212716 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:19:44.212689 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6760d320_1c9b_4248_a3b3_560a7f65bb7c.slice/crio-5c8d3d5531d2b1b4a7e4145bde57b84fa8ac9101e0a134cac3708da4a8a85963 WatchSource:0}: Error finding container 5c8d3d5531d2b1b4a7e4145bde57b84fa8ac9101e0a134cac3708da4a8a85963: Status 404 returned error can't find the container with id 5c8d3d5531d2b1b4a7e4145bde57b84fa8ac9101e0a134cac3708da4a8a85963 Jun 14 19:19:44.847367 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:44.847332 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq"] Jun 14 19:19:44.851143 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:44.851116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:44.853383 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:44.853357 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 19:19:44.853502 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:44.853413 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 19:19:44.853502 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:44.853490 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f4nrq\"" Jun 14 19:19:44.860136 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:44.859698 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq"] Jun 14 19:19:44.950658 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:44.950601 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7s9x\" (UniqueName: \"kubernetes.io/projected/8146c137-4de0-4633-bd75-cdb52baa3d5b-kube-api-access-n7s9x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:44.950828 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:44.950675 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:44.950828 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:44.950713 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:45.019836 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:45.019800 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" event={"ID":"6760d320-1c9b-4248-a3b3-560a7f65bb7c","Type":"ContainerStarted","Data":"5c8d3d5531d2b1b4a7e4145bde57b84fa8ac9101e0a134cac3708da4a8a85963"} Jun 14 19:19:45.051168 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:45.051129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7s9x\" (UniqueName: \"kubernetes.io/projected/8146c137-4de0-4633-bd75-cdb52baa3d5b-kube-api-access-n7s9x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:45.051168 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:45.051167 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:45.051405 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:45.051187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:45.051507 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:45.051490 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:45.051591 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:45.051568 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:45.059437 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:45.059411 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7s9x\" (UniqueName: \"kubernetes.io/projected/8146c137-4de0-4633-bd75-cdb52baa3d5b-kube-api-access-n7s9x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:45.163398 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:45.163302 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:45.906026 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:45.905994 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq"] Jun 14 19:19:45.909558 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:19:45.909529 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8146c137_4de0_4633_bd75_cdb52baa3d5b.slice/crio-d4fe7c0892b1ae0bba8659f296f7775e3897e23a8b01a8a844d4a353d7af3abe WatchSource:0}: Error finding container d4fe7c0892b1ae0bba8659f296f7775e3897e23a8b01a8a844d4a353d7af3abe: Status 404 returned error can't find the container with id d4fe7c0892b1ae0bba8659f296f7775e3897e23a8b01a8a844d4a353d7af3abe Jun 14 19:19:46.027962 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:46.027739 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" event={"ID":"925ea225-be08-4fb8-8999-63c236bd1fd8","Type":"ContainerStarted","Data":"1de8d8fca7becd6e2efa9c1936d5ffb743e8ea922fcd6c7edd3786d674e60a86"} Jun 14 19:19:46.028065 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:46.027962 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" Jun 14 19:19:46.029932 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:46.029901 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" event={"ID":"a435b7ed-4dc4-4390-b684-a3db72d42183","Type":"ContainerStarted","Data":"1adeed717b06fda615a1bfa4f52d4d0a1ea4a98174c1dc2b2bcbd9e134b9828e"} Jun 14 19:19:46.030115 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:46.029971 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" Jun 14 19:19:46.032455 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:46.032252 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" event={"ID":"8146c137-4de0-4633-bd75-cdb52baa3d5b","Type":"ContainerStarted","Data":"b6c97d598480e1725127db7c057f0cefc894f0d0e3a26a6acdc187de14eef80b"} Jun 14 19:19:46.032455 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:46.032327 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" event={"ID":"8146c137-4de0-4633-bd75-cdb52baa3d5b","Type":"ContainerStarted","Data":"d4fe7c0892b1ae0bba8659f296f7775e3897e23a8b01a8a844d4a353d7af3abe"} Jun 14 19:19:46.056488 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:46.056434 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" podStartSLOduration=0.858848634 podStartE2EDuration="4.056420264s" totalImagesPullingTime="3.19757163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:19:46.054214131 +0000 UTC m=+485.265145090" watchObservedRunningTime="2026-06-14 19:19:46.056420264 +0000 UTC m=+485.267351221" Jun 14 19:19:46.109440 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:46.109391 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" podStartSLOduration=0.906181661 podStartE2EDuration="4.109377724s" totalImagesPullingTime="3.203196063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:19:46.078413909 +0000 UTC m=+485.289344869" watchObservedRunningTime="2026-06-14 19:19:46.109377724 +0000 UTC m=+485.320308682" Jun 14 19:19:47.038718 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:47.038682 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" event={"ID":"6760d320-1c9b-4248-a3b3-560a7f65bb7c","Type":"ContainerStarted","Data":"296d4f0818d698e7dda8d0ced6e3d0d9b3254dfed83fe25c849e587c46b4fa68"} Jun 14 19:19:47.040187 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:47.040160 2559 generic.go:356] "Generic (PLEG): container finished" podID="8146c137-4de0-4633-bd75-cdb52baa3d5b" containerID="b6c97d598480e1725127db7c057f0cefc894f0d0e3a26a6acdc187de14eef80b" exitCode=0 Jun 14 19:19:47.040352 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:47.040248 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" event={"ID":"8146c137-4de0-4633-bd75-cdb52baa3d5b","Type":"ContainerDied","Data":"b6c97d598480e1725127db7c057f0cefc894f0d0e3a26a6acdc187de14eef80b"} Jun 14 19:19:47.085298 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:47.085253 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-675778c988-zrbq8" podStartSLOduration=1.433435148 podStartE2EDuration="4.085212551s" totalImagesPullingTime="2.651777403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:19:47.083531099 +0000 UTC m=+486.294462055" watchObservedRunningTime="2026-06-14 19:19:47.085212551 +0000 UTC m=+486.296143507" Jun 14 19:19:48.047572 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:48.047538 2559 generic.go:356] "Generic (PLEG): container finished" podID="8146c137-4de0-4633-bd75-cdb52baa3d5b" containerID="e62d556eb79c249f8e2a2afda1b74f9148ab4c78baa7e7a2412ad114d2ef8173" exitCode=0 Jun 14 19:19:48.047940 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:48.047617 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" event={"ID":"8146c137-4de0-4633-bd75-cdb52baa3d5b","Type":"ContainerDied","Data":"e62d556eb79c249f8e2a2afda1b74f9148ab4c78baa7e7a2412ad114d2ef8173"} Jun 14 19:19:48.986292 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:48.986264 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-2px2r" Jun 14 19:19:48.987939 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:48.987918 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-rd67z" Jun 14 19:19:49.054323 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:49.054292 2559 generic.go:356] "Generic (PLEG): container finished" podID="8146c137-4de0-4633-bd75-cdb52baa3d5b" containerID="04c2bb29282d7d272bc735a5c6127edf341cf09a0e12769bd0d1515df8a140a3" exitCode=0 Jun 14 19:19:49.054676 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:49.054376 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" event={"ID":"8146c137-4de0-4633-bd75-cdb52baa3d5b","Type":"ContainerDied","Data":"04c2bb29282d7d272bc735a5c6127edf341cf09a0e12769bd0d1515df8a140a3"} Jun 14 19:19:50.184766 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:50.184738 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:50.300918 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:50.300883 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7s9x\" (UniqueName: \"kubernetes.io/projected/8146c137-4de0-4633-bd75-cdb52baa3d5b-kube-api-access-n7s9x\") pod \"8146c137-4de0-4633-bd75-cdb52baa3d5b\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " Jun 14 19:19:50.301092 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:50.300982 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-bundle\") pod \"8146c137-4de0-4633-bd75-cdb52baa3d5b\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " Jun 14 19:19:50.301092 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:50.301042 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-util\") pod \"8146c137-4de0-4633-bd75-cdb52baa3d5b\" (UID: \"8146c137-4de0-4633-bd75-cdb52baa3d5b\") " Jun 14 19:19:50.301810 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:50.301785 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-bundle" (OuterVolumeSpecName: "bundle") pod "8146c137-4de0-4633-bd75-cdb52baa3d5b" (UID: "8146c137-4de0-4633-bd75-cdb52baa3d5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:19:50.302950 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:50.302928 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8146c137-4de0-4633-bd75-cdb52baa3d5b-kube-api-access-n7s9x" (OuterVolumeSpecName: "kube-api-access-n7s9x") pod "8146c137-4de0-4633-bd75-cdb52baa3d5b" (UID: "8146c137-4de0-4633-bd75-cdb52baa3d5b"). InnerVolumeSpecName "kube-api-access-n7s9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:19:50.306453 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:50.306432 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-util" (OuterVolumeSpecName: "util") pod "8146c137-4de0-4633-bd75-cdb52baa3d5b" (UID: "8146c137-4de0-4633-bd75-cdb52baa3d5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:19:50.402497 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:50.402411 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:19:50.402497 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:50.402439 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8146c137-4de0-4633-bd75-cdb52baa3d5b-util\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:19:50.402497 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:50.402449 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7s9x\" (UniqueName: \"kubernetes.io/projected/8146c137-4de0-4633-bd75-cdb52baa3d5b-kube-api-access-n7s9x\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:19:51.065578 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:51.065550 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" Jun 14 19:19:51.065767 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:51.065549 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06q4wrq" event={"ID":"8146c137-4de0-4633-bd75-cdb52baa3d5b","Type":"ContainerDied","Data":"d4fe7c0892b1ae0bba8659f296f7775e3897e23a8b01a8a844d4a353d7af3abe"} Jun 14 19:19:51.065767 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:51.065670 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4fe7c0892b1ae0bba8659f296f7775e3897e23a8b01a8a844d4a353d7af3abe" Jun 14 19:19:57.323910 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:57.323879 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:57.424460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:57.424426 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:58.415928 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:58.415896 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:58.515719 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:58.515686 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:59.139245 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.139195 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69"] Jun 14 19:19:59.139550 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.139536 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8146c137-4de0-4633-bd75-cdb52baa3d5b" containerName="util" Jun 14 19:19:59.139594 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.139551 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8146c137-4de0-4633-bd75-cdb52baa3d5b" containerName="util" Jun 14 19:19:59.139594 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.139565 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8146c137-4de0-4633-bd75-cdb52baa3d5b" containerName="pull" Jun 14 19:19:59.139594 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.139571 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8146c137-4de0-4633-bd75-cdb52baa3d5b" containerName="pull" Jun 14 19:19:59.139594 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.139578 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8146c137-4de0-4633-bd75-cdb52baa3d5b" containerName="extract" Jun 14 19:19:59.139594 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.139583 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8146c137-4de0-4633-bd75-cdb52baa3d5b" containerName="extract" Jun 14 19:19:59.139748 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.139632 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8146c137-4de0-4633-bd75-cdb52baa3d5b" containerName="extract" Jun 14 19:19:59.142645 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.142626 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:19:59.144812 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.144792 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 19:19:59.144812 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.144796 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 19:19:59.144972 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.144848 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f4nrq\"" Jun 14 19:19:59.152133 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.152113 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69"] Jun 14 19:19:59.275540 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.275508 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:19:59.275540 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.275549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k7g4\" (UniqueName: \"kubernetes.io/projected/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-kube-api-access-6k7g4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:19:59.275770 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.275628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:19:59.377052 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.377017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:19:59.377254 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.377104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:19:59.377254 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.377140 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k7g4\" (UniqueName: \"kubernetes.io/projected/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-kube-api-access-6k7g4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:19:59.377426 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.377403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:19:59.377512 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.377485 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:19:59.387140 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.387118 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k7g4\" (UniqueName: \"kubernetes.io/projected/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-kube-api-access-6k7g4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:19:59.426288 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.426188 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:59.452511 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.452486 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:19:59.525583 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.525551 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:59.584138 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.584120 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69"] Jun 14 19:19:59.586352 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:19:59.586322 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d593b4b_fc6d_43ff_bf82_e95a04ad1c89.slice/crio-ecb07466b4eb86c6543782badbc3bc34858794c974d80748fcc1bec364f596da WatchSource:0}: Error finding container ecb07466b4eb86c6543782badbc3bc34858794c974d80748fcc1bec364f596da: Status 404 returned error can't find the container with id ecb07466b4eb86c6543782badbc3bc34858794c974d80748fcc1bec364f596da Jun 14 19:19:59.824807 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.824779 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7d7df895cb-k6bqz"] Jun 14 19:19:59.828092 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.828076 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7d7df895cb-k6bqz" Jun 14 19:19:59.830802 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.830782 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qntw8\"" Jun 14 19:19:59.831564 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.831547 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 19:19:59.844682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.844656 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7d7df895cb-k6bqz"] Jun 14 19:19:59.893835 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.893800 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:19:59.980402 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.980317 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/99e77bc4-d320-4b0c-835d-4ebfd59751da-redirect-config\") pod \"dashboard-redirect-7d7df895cb-k6bqz\" (UID: \"99e77bc4-d320-4b0c-835d-4ebfd59751da\") " pod="opendatahub/dashboard-redirect-7d7df895cb-k6bqz" Jun 14 19:19:59.980402 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:19:59.980363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df9fl\" (UniqueName: \"kubernetes.io/projected/99e77bc4-d320-4b0c-835d-4ebfd59751da-kube-api-access-df9fl\") pod \"dashboard-redirect-7d7df895cb-k6bqz\" (UID: \"99e77bc4-d320-4b0c-835d-4ebfd59751da\") " pod="opendatahub/dashboard-redirect-7d7df895cb-k6bqz" Jun 14 19:20:00.081760 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:00.081725 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/99e77bc4-d320-4b0c-835d-4ebfd59751da-redirect-config\") pod \"dashboard-redirect-7d7df895cb-k6bqz\" (UID: \"99e77bc4-d320-4b0c-835d-4ebfd59751da\") " pod="opendatahub/dashboard-redirect-7d7df895cb-k6bqz" Jun 14 19:20:00.081940 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:00.081770 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df9fl\" (UniqueName: \"kubernetes.io/projected/99e77bc4-d320-4b0c-835d-4ebfd59751da-kube-api-access-df9fl\") pod \"dashboard-redirect-7d7df895cb-k6bqz\" (UID: \"99e77bc4-d320-4b0c-835d-4ebfd59751da\") " pod="opendatahub/dashboard-redirect-7d7df895cb-k6bqz" Jun 14 19:20:00.082517 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:00.082493 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/99e77bc4-d320-4b0c-835d-4ebfd59751da-redirect-config\") pod \"dashboard-redirect-7d7df895cb-k6bqz\" (UID: \"99e77bc4-d320-4b0c-835d-4ebfd59751da\") " pod="opendatahub/dashboard-redirect-7d7df895cb-k6bqz" Jun 14 19:20:00.089857 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:00.089838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df9fl\" (UniqueName: \"kubernetes.io/projected/99e77bc4-d320-4b0c-835d-4ebfd59751da-kube-api-access-df9fl\") pod \"dashboard-redirect-7d7df895cb-k6bqz\" (UID: \"99e77bc4-d320-4b0c-835d-4ebfd59751da\") " pod="opendatahub/dashboard-redirect-7d7df895cb-k6bqz" Jun 14 19:20:00.107970 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:00.107947 2559 generic.go:356] "Generic (PLEG): container finished" podID="5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" containerID="ff9ade4185efe326d67d03f05e44d38a082494f99b87ef07aea26ab81bf78a41" exitCode=0 Jun 14 19:20:00.108081 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:00.108008 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" event={"ID":"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89","Type":"ContainerDied","Data":"ff9ade4185efe326d67d03f05e44d38a082494f99b87ef07aea26ab81bf78a41"} Jun 14 19:20:00.108081 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:00.108041 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" event={"ID":"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89","Type":"ContainerStarted","Data":"ecb07466b4eb86c6543782badbc3bc34858794c974d80748fcc1bec364f596da"} Jun 14 19:20:00.138336 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:00.138316 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7d7df895cb-k6bqz" Jun 14 19:20:00.264941 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:00.264898 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7d7df895cb-k6bqz"] Jun 14 19:20:00.266942 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:20:00.266913 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e77bc4_d320_4b0c_835d_4ebfd59751da.slice/crio-05bc26a5bc87a1408ef74e3155d7dd2c3356e8039e607a17b3ebc1d00c92b8e0 WatchSource:0}: Error finding container 05bc26a5bc87a1408ef74e3155d7dd2c3356e8039e607a17b3ebc1d00c92b8e0: Status 404 returned error can't find the container with id 05bc26a5bc87a1408ef74e3155d7dd2c3356e8039e607a17b3ebc1d00c92b8e0 Jun 14 19:20:00.850910 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:00.850886 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:01.037008 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.036972 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x"] Jun 14 19:20:01.040134 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.040118 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" Jun 14 19:20:01.042607 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.042579 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-s9w27\"" Jun 14 19:20:01.042743 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.042633 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 14 19:20:01.042743 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.042643 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 14 19:20:01.053117 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.053093 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x"] Jun 14 19:20:01.114122 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.114036 2559 generic.go:356] "Generic (PLEG): container finished" podID="5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" containerID="7eb5c7cdd368fc49f0fe576560f22a40f121bd3aa18a3ae41cf8acc94a08ac50" exitCode=0 Jun 14 19:20:01.114284 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.114172 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" event={"ID":"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89","Type":"ContainerDied","Data":"7eb5c7cdd368fc49f0fe576560f22a40f121bd3aa18a3ae41cf8acc94a08ac50"} Jun 14 19:20:01.115448 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.115421 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7d7df895cb-k6bqz" event={"ID":"99e77bc4-d320-4b0c-835d-4ebfd59751da","Type":"ContainerStarted","Data":"05bc26a5bc87a1408ef74e3155d7dd2c3356e8039e607a17b3ebc1d00c92b8e0"} Jun 14 19:20:01.191711 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.191684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d87fd0d3-bc19-4cc0-a877-876772352bc8-operator-config\") pod \"servicemesh-operator3-57f65f65fb-pbz9x\" (UID: \"d87fd0d3-bc19-4cc0-a877-876772352bc8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" Jun 14 19:20:01.191824 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.191733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwbcx\" (UniqueName: \"kubernetes.io/projected/d87fd0d3-bc19-4cc0-a877-876772352bc8-kube-api-access-cwbcx\") pod \"servicemesh-operator3-57f65f65fb-pbz9x\" (UID: \"d87fd0d3-bc19-4cc0-a877-876772352bc8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" Jun 14 19:20:01.292733 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.292702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d87fd0d3-bc19-4cc0-a877-876772352bc8-operator-config\") pod \"servicemesh-operator3-57f65f65fb-pbz9x\" (UID: \"d87fd0d3-bc19-4cc0-a877-876772352bc8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" Jun 14 19:20:01.292733 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.292746 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwbcx\" (UniqueName: \"kubernetes.io/projected/d87fd0d3-bc19-4cc0-a877-876772352bc8-kube-api-access-cwbcx\") pod \"servicemesh-operator3-57f65f65fb-pbz9x\" (UID: \"d87fd0d3-bc19-4cc0-a877-876772352bc8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" Jun 14 19:20:01.295237 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.295204 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d87fd0d3-bc19-4cc0-a877-876772352bc8-operator-config\") pod \"servicemesh-operator3-57f65f65fb-pbz9x\" (UID: \"d87fd0d3-bc19-4cc0-a877-876772352bc8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" Jun 14 19:20:01.306863 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.306840 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwbcx\" (UniqueName: \"kubernetes.io/projected/d87fd0d3-bc19-4cc0-a877-876772352bc8-kube-api-access-cwbcx\") pod \"servicemesh-operator3-57f65f65fb-pbz9x\" (UID: \"d87fd0d3-bc19-4cc0-a877-876772352bc8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" Jun 14 19:20:01.349438 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.349417 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" Jun 14 19:20:01.483593 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:01.483560 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x"] Jun 14 19:20:01.487384 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:20:01.487353 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87fd0d3_bc19_4cc0_a877_876772352bc8.slice/crio-cf35b143e2ff04b6402e2898a175a98e580a9330ef7a6e4800c2b1ba3801cfad WatchSource:0}: Error finding container cf35b143e2ff04b6402e2898a175a98e580a9330ef7a6e4800c2b1ba3801cfad: Status 404 returned error can't find the container with id cf35b143e2ff04b6402e2898a175a98e580a9330ef7a6e4800c2b1ba3801cfad Jun 14 19:20:02.121020 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:02.120986 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" event={"ID":"d87fd0d3-bc19-4cc0-a877-876772352bc8","Type":"ContainerStarted","Data":"cf35b143e2ff04b6402e2898a175a98e580a9330ef7a6e4800c2b1ba3801cfad"} Jun 14 19:20:02.123095 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:02.123072 2559 generic.go:356] "Generic (PLEG): container finished" podID="5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" containerID="bd57035c0d3a51e7906f5b2656734c089980106ff5e94c0366d9cb1a89177d90" exitCode=0 Jun 14 19:20:02.123239 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:02.123128 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" event={"ID":"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89","Type":"ContainerDied","Data":"bd57035c0d3a51e7906f5b2656734c089980106ff5e94c0366d9cb1a89177d90"} Jun 14 19:20:03.985640 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:03.985614 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:20:04.118766 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.118738 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-bundle\") pod \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " Jun 14 19:20:04.118912 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.118793 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k7g4\" (UniqueName: \"kubernetes.io/projected/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-kube-api-access-6k7g4\") pod \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " Jun 14 19:20:04.118912 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.118893 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-util\") pod \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\" (UID: \"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89\") " Jun 14 19:20:04.120030 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.119988 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-bundle" (OuterVolumeSpecName: "bundle") pod "5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" (UID: "5d593b4b-fc6d-43ff-bf82-e95a04ad1c89"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:20:04.126615 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.126551 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-kube-api-access-6k7g4" (OuterVolumeSpecName: "kube-api-access-6k7g4") pod "5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" (UID: "5d593b4b-fc6d-43ff-bf82-e95a04ad1c89"). InnerVolumeSpecName "kube-api-access-6k7g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:20:04.127065 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.127037 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-util" (OuterVolumeSpecName: "util") pod "5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" (UID: "5d593b4b-fc6d-43ff-bf82-e95a04ad1c89"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:20:04.140764 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.140730 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" event={"ID":"5d593b4b-fc6d-43ff-bf82-e95a04ad1c89","Type":"ContainerDied","Data":"ecb07466b4eb86c6543782badbc3bc34858794c974d80748fcc1bec364f596da"} Jun 14 19:20:04.140908 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.140789 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecb07466b4eb86c6543782badbc3bc34858794c974d80748fcc1bec364f596da" Jun 14 19:20:04.140908 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.140875 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9d69" Jun 14 19:20:04.144152 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.144125 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" event={"ID":"d87fd0d3-bc19-4cc0-a877-876772352bc8","Type":"ContainerStarted","Data":"6cb8f90d80df51405a8cc66d325fade1297a25e08c620f03cfa6d029e331087c"} Jun 14 19:20:04.145814 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.145783 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" Jun 14 19:20:04.199304 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.199238 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" podStartSLOduration=0.661162814 podStartE2EDuration="3.199202136s" totalImagesPullingTime="2.538039322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:20:04.197133748 +0000 UTC m=+503.408064706" watchObservedRunningTime="2026-06-14 19:20:04.199202136 +0000 UTC m=+503.410133094" Jun 14 19:20:04.219731 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.219645 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-util\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:04.219731 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.219688 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:04.219731 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:04.219703 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k7g4\" (UniqueName: \"kubernetes.io/projected/5d593b4b-fc6d-43ff-bf82-e95a04ad1c89-kube-api-access-6k7g4\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:06.157712 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:06.157667 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7d7df895cb-k6bqz" event={"ID":"99e77bc4-d320-4b0c-835d-4ebfd59751da","Type":"ContainerStarted","Data":"cc28326803c76d357f85b5e79b2e3f2c6e799e2caa8e7e72555346d68fb4cc34"} Jun 14 19:20:06.171450 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:06.171405 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7d7df895cb-k6bqz" podStartSLOduration=2.132177364 podStartE2EDuration="7.171387451s" totalImagesPullingTime="5.039210087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:20:06.17024053 +0000 UTC m=+505.381171488" watchObservedRunningTime="2026-06-14 19:20:06.171387451 +0000 UTC m=+505.382318410" Jun 14 19:20:10.239703 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.239669 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp"] Jun 14 19:20:10.240162 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.240003 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" containerName="util" Jun 14 19:20:10.240162 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.240013 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" containerName="util" Jun 14 19:20:10.240162 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.240022 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" containerName="extract" Jun 14 19:20:10.240162 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.240028 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" containerName="extract" Jun 14 19:20:10.240162 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.240038 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" containerName="pull" Jun 14 19:20:10.240162 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.240044 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" containerName="pull" Jun 14 19:20:10.240162 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.240119 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d593b4b-fc6d-43ff-bf82-e95a04ad1c89" containerName="extract" Jun 14 19:20:10.246168 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.246146 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.248174 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.248149 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 19:20:10.248174 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.248162 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 14 19:20:10.248390 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.248175 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 14 19:20:10.248390 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.248149 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 14 19:20:10.248537 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.248519 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b6sbf\"" Jun 14 19:20:10.254213 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.254192 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:10.255741 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.255717 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp"] Jun 14 19:20:10.315616 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.315587 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:10.367746 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.367715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4205af7-b135-476e-9e37-c692d82e53c2-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.367902 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.367751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4205af7-b135-476e-9e37-c692d82e53c2-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.367902 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.367784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfqhl\" (UniqueName: \"kubernetes.io/projected/d4205af7-b135-476e-9e37-c692d82e53c2-kube-api-access-qfqhl\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.367902 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.367812 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4205af7-b135-476e-9e37-c692d82e53c2-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.367902 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.367848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d4205af7-b135-476e-9e37-c692d82e53c2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.367902 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.367876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d4205af7-b135-476e-9e37-c692d82e53c2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.368090 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.367953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d4205af7-b135-476e-9e37-c692d82e53c2-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.468462 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.468428 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4205af7-b135-476e-9e37-c692d82e53c2-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.468647 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.468473 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4205af7-b135-476e-9e37-c692d82e53c2-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.468647 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.468495 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfqhl\" (UniqueName: \"kubernetes.io/projected/d4205af7-b135-476e-9e37-c692d82e53c2-kube-api-access-qfqhl\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.468647 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.468524 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4205af7-b135-476e-9e37-c692d82e53c2-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.468804 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.468722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d4205af7-b135-476e-9e37-c692d82e53c2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.468866 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.468853 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d4205af7-b135-476e-9e37-c692d82e53c2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.469002 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.468959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d4205af7-b135-476e-9e37-c692d82e53c2-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.469429 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.469404 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d4205af7-b135-476e-9e37-c692d82e53c2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.470975 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.470951 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4205af7-b135-476e-9e37-c692d82e53c2-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.471155 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.471127 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d4205af7-b135-476e-9e37-c692d82e53c2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.471286 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.471256 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4205af7-b135-476e-9e37-c692d82e53c2-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.471443 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.471426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d4205af7-b135-476e-9e37-c692d82e53c2-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.475925 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.475900 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4205af7-b135-476e-9e37-c692d82e53c2-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.476010 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.475989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfqhl\" (UniqueName: \"kubernetes.io/projected/d4205af7-b135-476e-9e37-c692d82e53c2-kube-api-access-qfqhl\") pod \"istiod-openshift-gateway-75c67f8887-snsgp\" (UID: \"d4205af7-b135-476e-9e37-c692d82e53c2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.557030 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.556999 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:10.696141 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.696109 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp"] Jun 14 19:20:10.699673 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:20:10.699638 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4205af7_b135_476e_9e37_c692d82e53c2.slice/crio-12ca8829c8f3288fd9a6e7d9ed259fbefd8b94e631c6c66068c6391b325356c6 WatchSource:0}: Error finding container 12ca8829c8f3288fd9a6e7d9ed259fbefd8b94e631c6c66068c6391b325356c6: Status 404 returned error can't find the container with id 12ca8829c8f3288fd9a6e7d9ed259fbefd8b94e631c6c66068c6391b325356c6 Jun 14 19:20:10.771853 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.771820 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:10.987196 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:10.987125 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:11.040664 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:11.040632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:11.183827 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:11.183794 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" event={"ID":"d4205af7-b135-476e-9e37-c692d82e53c2","Type":"ContainerStarted","Data":"12ca8829c8f3288fd9a6e7d9ed259fbefd8b94e631c6c66068c6391b325356c6"} Jun 14 19:20:13.174123 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:13.174062 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 19:20:13.174424 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:13.174150 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 19:20:13.645981 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:13.645940 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:13.745953 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:13.745923 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:13.933295 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:13.933205 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:14.123392 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:14.123361 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:14.202338 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:14.202259 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" event={"ID":"d4205af7-b135-476e-9e37-c692d82e53c2","Type":"ContainerStarted","Data":"7cf2085241f6dcf0175b6ca63c6cf71cc51efbe78d7e3264484b4c62f2276423"} Jun 14 19:20:14.202702 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:14.202476 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:14.204145 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:14.204124 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" Jun 14 19:20:14.220239 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:14.220185 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-snsgp" podStartSLOduration=1.7481075910000001 podStartE2EDuration="4.220170233s" totalImagesPullingTime="2.472062642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:20:14.218816828 +0000 UTC m=+513.429747818" watchObservedRunningTime="2026-06-14 19:20:14.220170233 +0000 UTC m=+513.431101189" Jun 14 19:20:14.395330 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:14.395299 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:14.682911 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:14.682880 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:16.160372 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:16.160339 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-pbz9x" Jun 14 19:20:17.042298 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:17.042266 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z5j4h" Jun 14 19:20:17.045266 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:17.045245 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-zgzbc" Jun 14 19:20:25.625137 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:25.625062 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:25.725983 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:25.725949 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:32.871800 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:32.871760 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:32.976861 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:32.976834 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:33.057799 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:33.057773 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:33.826881 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:33.826843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:34.028348 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:34.028318 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:42.547741 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:42.547705 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:20:49.244672 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.244638 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb"] Jun 14 19:20:49.266298 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.266263 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb"] Jun 14 19:20:49.266478 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.266398 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:49.269372 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.269351 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 19:20:49.269762 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.269742 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 19:20:49.269984 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.269967 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s865v\"" Jun 14 19:20:49.394867 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.394832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:49.395034 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.394880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:49.395034 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.394899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx5fq\" (UniqueName: \"kubernetes.io/projected/457e8ef8-9990-41e3-858d-f0d8702e40d0-kube-api-access-qx5fq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:49.495701 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.495595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:49.495701 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.495652 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:49.495701 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.495671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx5fq\" (UniqueName: \"kubernetes.io/projected/457e8ef8-9990-41e3-858d-f0d8702e40d0-kube-api-access-qx5fq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:49.496017 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.495970 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:49.496074 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.496051 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:49.504362 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.504335 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx5fq\" (UniqueName: \"kubernetes.io/projected/457e8ef8-9990-41e3-858d-f0d8702e40d0-kube-api-access-qx5fq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:49.583303 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.583264 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:49.720595 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:49.720569 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb"] Jun 14 19:20:49.723204 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:20:49.723175 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457e8ef8_9990_41e3_858d_f0d8702e40d0.slice/crio-38ce2af0b73a91b5814c227c743faa683f4ca257f62512cb14b3f5527257c6a3 WatchSource:0}: Error finding container 38ce2af0b73a91b5814c227c743faa683f4ca257f62512cb14b3f5527257c6a3: Status 404 returned error can't find the container with id 38ce2af0b73a91b5814c227c743faa683f4ca257f62512cb14b3f5527257c6a3 Jun 14 19:20:50.033068 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.032989 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn"] Jun 14 19:20:50.036398 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.036378 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:50.047534 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.047512 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn"] Jun 14 19:20:50.101824 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.101790 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:50.101992 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.101837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:50.101992 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.101897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzv25\" (UniqueName: \"kubernetes.io/projected/d07a9cc2-4b57-40a3-85a7-745ed242877e-kube-api-access-rzv25\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:50.202315 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.202278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:50.202495 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.202325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:50.202495 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.202359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzv25\" (UniqueName: \"kubernetes.io/projected/d07a9cc2-4b57-40a3-85a7-745ed242877e-kube-api-access-rzv25\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:50.202682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.202657 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:50.202759 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.202739 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:50.211937 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.211909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzv25\" (UniqueName: \"kubernetes.io/projected/d07a9cc2-4b57-40a3-85a7-745ed242877e-kube-api-access-rzv25\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:50.345491 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.345459 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:50.386210 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.386175 2559 generic.go:356] "Generic (PLEG): container finished" podID="457e8ef8-9990-41e3-858d-f0d8702e40d0" containerID="4fbf3aad08f41f782bea2c85f6677f61a14ac0937b98e6ad4357c4290a4d2127" exitCode=0 Jun 14 19:20:50.386399 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.386255 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" event={"ID":"457e8ef8-9990-41e3-858d-f0d8702e40d0","Type":"ContainerDied","Data":"4fbf3aad08f41f782bea2c85f6677f61a14ac0937b98e6ad4357c4290a4d2127"} Jun 14 19:20:50.386399 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.386308 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" event={"ID":"457e8ef8-9990-41e3-858d-f0d8702e40d0","Type":"ContainerStarted","Data":"38ce2af0b73a91b5814c227c743faa683f4ca257f62512cb14b3f5527257c6a3"} Jun 14 19:20:50.483502 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.483476 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn"] Jun 14 19:20:50.484900 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:20:50.484873 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07a9cc2_4b57_40a3_85a7_745ed242877e.slice/crio-79a6eedb296e5adb40a4ba7c5d33bd727d3bc809e6931ff2d932ef8337d922b9 WatchSource:0}: Error finding container 79a6eedb296e5adb40a4ba7c5d33bd727d3bc809e6931ff2d932ef8337d922b9: Status 404 returned error can't find the container with id 79a6eedb296e5adb40a4ba7c5d33bd727d3bc809e6931ff2d932ef8337d922b9 Jun 14 19:20:50.834618 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.834583 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn"] Jun 14 19:20:50.837969 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.837953 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:50.845922 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.845902 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn"] Jun 14 19:20:50.909396 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.909325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:50.909396 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.909369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkcw5\" (UniqueName: \"kubernetes.io/projected/627fac7f-354e-4874-aa5e-aba8023f0292-kube-api-access-mkcw5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:50.909588 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:50.909439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:51.010830 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.010799 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:51.010979 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.010859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkcw5\" (UniqueName: \"kubernetes.io/projected/627fac7f-354e-4874-aa5e-aba8023f0292-kube-api-access-mkcw5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:51.010979 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.010904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:51.011260 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.011208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:51.011310 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.011256 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:51.018766 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.018744 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkcw5\" (UniqueName: \"kubernetes.io/projected/627fac7f-354e-4874-aa5e-aba8023f0292-kube-api-access-mkcw5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:51.149109 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.148767 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:51.287391 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.287369 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn"] Jun 14 19:20:51.309985 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:20:51.309955 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627fac7f_354e_4874_aa5e_aba8023f0292.slice/crio-a00bfca7602474e9c59f57c8deeaf6817c326cc6ce2268286614411f1f72ee0d WatchSource:0}: Error finding container a00bfca7602474e9c59f57c8deeaf6817c326cc6ce2268286614411f1f72ee0d: Status 404 returned error can't find the container with id a00bfca7602474e9c59f57c8deeaf6817c326cc6ce2268286614411f1f72ee0d Jun 14 19:20:51.392840 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.392807 2559 generic.go:356] "Generic (PLEG): container finished" podID="d07a9cc2-4b57-40a3-85a7-745ed242877e" containerID="8b7903b142d5751ddff16fd4a24b3e1e7b53244e97238a52aeffd786ab84de38" exitCode=0 Jun 14 19:20:51.393249 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.392844 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" event={"ID":"d07a9cc2-4b57-40a3-85a7-745ed242877e","Type":"ContainerDied","Data":"8b7903b142d5751ddff16fd4a24b3e1e7b53244e97238a52aeffd786ab84de38"} Jun 14 19:20:51.393249 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.392896 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" event={"ID":"d07a9cc2-4b57-40a3-85a7-745ed242877e","Type":"ContainerStarted","Data":"79a6eedb296e5adb40a4ba7c5d33bd727d3bc809e6931ff2d932ef8337d922b9"} Jun 14 19:20:51.395087 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.395061 2559 generic.go:356] "Generic (PLEG): container finished" podID="457e8ef8-9990-41e3-858d-f0d8702e40d0" containerID="142ae3119d9c7496d062609e915b2d1407ec2acbc637b6cebd253dd16c66cca6" exitCode=0 Jun 14 19:20:51.395217 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.395108 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" event={"ID":"457e8ef8-9990-41e3-858d-f0d8702e40d0","Type":"ContainerDied","Data":"142ae3119d9c7496d062609e915b2d1407ec2acbc637b6cebd253dd16c66cca6"} Jun 14 19:20:51.397123 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.397097 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" event={"ID":"627fac7f-354e-4874-aa5e-aba8023f0292","Type":"ContainerStarted","Data":"8d96514abbf2046af974818e8d24a4f06418cdfbce437c40480fc0bdfa5f4b44"} Jun 14 19:20:51.397193 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.397131 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" event={"ID":"627fac7f-354e-4874-aa5e-aba8023f0292","Type":"ContainerStarted","Data":"a00bfca7602474e9c59f57c8deeaf6817c326cc6ce2268286614411f1f72ee0d"} Jun 14 19:20:51.442269 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.442192 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh"] Jun 14 19:20:51.448650 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.448380 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:51.457171 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.457147 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh"] Jun 14 19:20:51.515069 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.515040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6f5z\" (UniqueName: \"kubernetes.io/projected/0de21275-017b-4967-a554-0588860e764b-kube-api-access-f6f5z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:51.515238 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.515085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:51.515238 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.515134 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:51.615841 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.615811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6f5z\" (UniqueName: \"kubernetes.io/projected/0de21275-017b-4967-a554-0588860e764b-kube-api-access-f6f5z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:51.615947 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.615847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:51.615947 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.615891 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:51.616191 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.616173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:51.616292 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.616214 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:51.628098 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.628076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6f5z\" (UniqueName: \"kubernetes.io/projected/0de21275-017b-4967-a554-0588860e764b-kube-api-access-f6f5z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:51.770908 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.770859 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:51.900630 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:51.900600 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh"] Jun 14 19:20:51.902265 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:20:51.902238 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de21275_017b_4967_a554_0588860e764b.slice/crio-181bbb891ba11c544770492fcd0291340f4d9ba76eacdd514a418b3bf0d57c0c WatchSource:0}: Error finding container 181bbb891ba11c544770492fcd0291340f4d9ba76eacdd514a418b3bf0d57c0c: Status 404 returned error can't find the container with id 181bbb891ba11c544770492fcd0291340f4d9ba76eacdd514a418b3bf0d57c0c Jun 14 19:20:52.405672 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:52.405594 2559 generic.go:356] "Generic (PLEG): container finished" podID="457e8ef8-9990-41e3-858d-f0d8702e40d0" containerID="6912632eaa252f0cc2cf4750f4c797c49370a3cbac9c279e1a0c3bd54dc30cc5" exitCode=0 Jun 14 19:20:52.406016 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:52.405674 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" event={"ID":"457e8ef8-9990-41e3-858d-f0d8702e40d0","Type":"ContainerDied","Data":"6912632eaa252f0cc2cf4750f4c797c49370a3cbac9c279e1a0c3bd54dc30cc5"} Jun 14 19:20:52.407252 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:52.407208 2559 generic.go:356] "Generic (PLEG): container finished" podID="627fac7f-354e-4874-aa5e-aba8023f0292" containerID="8d96514abbf2046af974818e8d24a4f06418cdfbce437c40480fc0bdfa5f4b44" exitCode=0 Jun 14 19:20:52.407354 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:52.407257 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" event={"ID":"627fac7f-354e-4874-aa5e-aba8023f0292","Type":"ContainerDied","Data":"8d96514abbf2046af974818e8d24a4f06418cdfbce437c40480fc0bdfa5f4b44"} Jun 14 19:20:52.409273 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:52.409248 2559 generic.go:356] "Generic (PLEG): container finished" podID="d07a9cc2-4b57-40a3-85a7-745ed242877e" containerID="4dcde8be45081ae13f926ba9a1d6aca04dca72ba943a73ffc8e7d0c1d3cbcd27" exitCode=0 Jun 14 19:20:52.409386 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:52.409363 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" event={"ID":"d07a9cc2-4b57-40a3-85a7-745ed242877e","Type":"ContainerDied","Data":"4dcde8be45081ae13f926ba9a1d6aca04dca72ba943a73ffc8e7d0c1d3cbcd27"} Jun 14 19:20:52.411000 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:52.410977 2559 generic.go:356] "Generic (PLEG): container finished" podID="0de21275-017b-4967-a554-0588860e764b" containerID="140693dd1a6d06ace12b2942b0ce2c0bb69bece988e6dae74618203be08146fc" exitCode=0 Jun 14 19:20:52.411088 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:52.411009 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" event={"ID":"0de21275-017b-4967-a554-0588860e764b","Type":"ContainerDied","Data":"140693dd1a6d06ace12b2942b0ce2c0bb69bece988e6dae74618203be08146fc"} Jun 14 19:20:52.411088 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:52.411036 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" event={"ID":"0de21275-017b-4967-a554-0588860e764b","Type":"ContainerStarted","Data":"181bbb891ba11c544770492fcd0291340f4d9ba76eacdd514a418b3bf0d57c0c"} Jun 14 19:20:53.418726 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.418694 2559 generic.go:356] "Generic (PLEG): container finished" podID="627fac7f-354e-4874-aa5e-aba8023f0292" containerID="be7d1b2d6981f97674d597b5295892065b32d68a557bc1c0f37d21f3b900053c" exitCode=0 Jun 14 19:20:53.419132 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.418774 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" event={"ID":"627fac7f-354e-4874-aa5e-aba8023f0292","Type":"ContainerDied","Data":"be7d1b2d6981f97674d597b5295892065b32d68a557bc1c0f37d21f3b900053c"} Jun 14 19:20:53.421079 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.421057 2559 generic.go:356] "Generic (PLEG): container finished" podID="d07a9cc2-4b57-40a3-85a7-745ed242877e" containerID="cb934d28c2b3eba44f185955a9e721cb6c5b706075fa13a6218f01d8bfeab67d" exitCode=0 Jun 14 19:20:53.421163 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.421126 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" event={"ID":"d07a9cc2-4b57-40a3-85a7-745ed242877e","Type":"ContainerDied","Data":"cb934d28c2b3eba44f185955a9e721cb6c5b706075fa13a6218f01d8bfeab67d"} Jun 14 19:20:53.422806 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.422777 2559 generic.go:356] "Generic (PLEG): container finished" podID="0de21275-017b-4967-a554-0588860e764b" containerID="ffbb1507834a90d9ef80e180e7e2652cc0ad13b4d070e178a4b121113ae18c87" exitCode=0 Jun 14 19:20:53.422884 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.422856 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" event={"ID":"0de21275-017b-4967-a554-0588860e764b","Type":"ContainerDied","Data":"ffbb1507834a90d9ef80e180e7e2652cc0ad13b4d070e178a4b121113ae18c87"} Jun 14 19:20:53.571581 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.571523 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:53.733600 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.733519 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx5fq\" (UniqueName: \"kubernetes.io/projected/457e8ef8-9990-41e3-858d-f0d8702e40d0-kube-api-access-qx5fq\") pod \"457e8ef8-9990-41e3-858d-f0d8702e40d0\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " Jun 14 19:20:53.733600 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.733596 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-bundle\") pod \"457e8ef8-9990-41e3-858d-f0d8702e40d0\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " Jun 14 19:20:53.733811 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.733641 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-util\") pod \"457e8ef8-9990-41e3-858d-f0d8702e40d0\" (UID: \"457e8ef8-9990-41e3-858d-f0d8702e40d0\") " Jun 14 19:20:53.734073 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.734049 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-bundle" (OuterVolumeSpecName: "bundle") pod "457e8ef8-9990-41e3-858d-f0d8702e40d0" (UID: "457e8ef8-9990-41e3-858d-f0d8702e40d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:20:53.735685 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.735664 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457e8ef8-9990-41e3-858d-f0d8702e40d0-kube-api-access-qx5fq" (OuterVolumeSpecName: "kube-api-access-qx5fq") pod "457e8ef8-9990-41e3-858d-f0d8702e40d0" (UID: "457e8ef8-9990-41e3-858d-f0d8702e40d0"). InnerVolumeSpecName "kube-api-access-qx5fq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:20:53.739351 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.739317 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-util" (OuterVolumeSpecName: "util") pod "457e8ef8-9990-41e3-858d-f0d8702e40d0" (UID: "457e8ef8-9990-41e3-858d-f0d8702e40d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:20:53.835295 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.835257 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx5fq\" (UniqueName: \"kubernetes.io/projected/457e8ef8-9990-41e3-858d-f0d8702e40d0-kube-api-access-qx5fq\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:53.835295 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.835295 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:53.835295 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:53.835305 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/457e8ef8-9990-41e3-858d-f0d8702e40d0-util\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:54.430289 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.430254 2559 generic.go:356] "Generic (PLEG): container finished" podID="627fac7f-354e-4874-aa5e-aba8023f0292" containerID="75cb2ecc801ff35d8a4b2e07be53e4dceba3ee82786dd74173c4dcc9b3af313a" exitCode=0 Jun 14 19:20:54.430736 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.430351 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" event={"ID":"627fac7f-354e-4874-aa5e-aba8023f0292","Type":"ContainerDied","Data":"75cb2ecc801ff35d8a4b2e07be53e4dceba3ee82786dd74173c4dcc9b3af313a"} Jun 14 19:20:54.432439 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.432415 2559 generic.go:356] "Generic (PLEG): container finished" podID="0de21275-017b-4967-a554-0588860e764b" containerID="1edd1536a24ad6bf308d1ac81f6aae46c30881e8a749cb4a7c02cd093e3c24f3" exitCode=0 Jun 14 19:20:54.432526 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.432494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" event={"ID":"0de21275-017b-4967-a554-0588860e764b","Type":"ContainerDied","Data":"1edd1536a24ad6bf308d1ac81f6aae46c30881e8a749cb4a7c02cd093e3c24f3"} Jun 14 19:20:54.434192 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.434175 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" Jun 14 19:20:54.434297 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.434204 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb" event={"ID":"457e8ef8-9990-41e3-858d-f0d8702e40d0","Type":"ContainerDied","Data":"38ce2af0b73a91b5814c227c743faa683f4ca257f62512cb14b3f5527257c6a3"} Jun 14 19:20:54.434297 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.434253 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38ce2af0b73a91b5814c227c743faa683f4ca257f62512cb14b3f5527257c6a3" Jun 14 19:20:54.570718 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.570695 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:54.641747 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.641720 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzv25\" (UniqueName: \"kubernetes.io/projected/d07a9cc2-4b57-40a3-85a7-745ed242877e-kube-api-access-rzv25\") pod \"d07a9cc2-4b57-40a3-85a7-745ed242877e\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " Jun 14 19:20:54.641896 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.641789 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-util\") pod \"d07a9cc2-4b57-40a3-85a7-745ed242877e\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " Jun 14 19:20:54.641896 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.641814 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-bundle\") pod \"d07a9cc2-4b57-40a3-85a7-745ed242877e\" (UID: \"d07a9cc2-4b57-40a3-85a7-745ed242877e\") " Jun 14 19:20:54.642414 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.642381 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-bundle" (OuterVolumeSpecName: "bundle") pod "d07a9cc2-4b57-40a3-85a7-745ed242877e" (UID: "d07a9cc2-4b57-40a3-85a7-745ed242877e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:20:54.643761 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.643735 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d07a9cc2-4b57-40a3-85a7-745ed242877e-kube-api-access-rzv25" (OuterVolumeSpecName: "kube-api-access-rzv25") pod "d07a9cc2-4b57-40a3-85a7-745ed242877e" (UID: "d07a9cc2-4b57-40a3-85a7-745ed242877e"). InnerVolumeSpecName "kube-api-access-rzv25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:20:54.646966 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.646945 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-util" (OuterVolumeSpecName: "util") pod "d07a9cc2-4b57-40a3-85a7-745ed242877e" (UID: "d07a9cc2-4b57-40a3-85a7-745ed242877e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:20:54.742734 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.742655 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzv25\" (UniqueName: \"kubernetes.io/projected/d07a9cc2-4b57-40a3-85a7-745ed242877e-kube-api-access-rzv25\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:54.742734 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.742682 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-util\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:54.742734 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:54.742691 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d07a9cc2-4b57-40a3-85a7-745ed242877e-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:55.440893 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.440863 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" Jun 14 19:20:55.441305 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.440897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn" event={"ID":"d07a9cc2-4b57-40a3-85a7-745ed242877e","Type":"ContainerDied","Data":"79a6eedb296e5adb40a4ba7c5d33bd727d3bc809e6931ff2d932ef8337d922b9"} Jun 14 19:20:55.441305 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.440946 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79a6eedb296e5adb40a4ba7c5d33bd727d3bc809e6931ff2d932ef8337d922b9" Jun 14 19:20:55.592519 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.592499 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:55.595053 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.595034 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:55.751832 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.751794 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-bundle\") pod \"627fac7f-354e-4874-aa5e-aba8023f0292\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " Jun 14 19:20:55.751832 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.751838 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkcw5\" (UniqueName: \"kubernetes.io/projected/627fac7f-354e-4874-aa5e-aba8023f0292-kube-api-access-mkcw5\") pod \"627fac7f-354e-4874-aa5e-aba8023f0292\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " Jun 14 19:20:55.752073 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.751865 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-bundle\") pod \"0de21275-017b-4967-a554-0588860e764b\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " Jun 14 19:20:55.752073 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.751920 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-util\") pod \"0de21275-017b-4967-a554-0588860e764b\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " Jun 14 19:20:55.752073 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.751962 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6f5z\" (UniqueName: \"kubernetes.io/projected/0de21275-017b-4967-a554-0588860e764b-kube-api-access-f6f5z\") pod \"0de21275-017b-4967-a554-0588860e764b\" (UID: \"0de21275-017b-4967-a554-0588860e764b\") " Jun 14 19:20:55.752073 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.752001 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-util\") pod \"627fac7f-354e-4874-aa5e-aba8023f0292\" (UID: \"627fac7f-354e-4874-aa5e-aba8023f0292\") " Jun 14 19:20:55.752520 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.752487 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-bundle" (OuterVolumeSpecName: "bundle") pod "0de21275-017b-4967-a554-0588860e764b" (UID: "0de21275-017b-4967-a554-0588860e764b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:20:55.752520 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.752506 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-bundle" (OuterVolumeSpecName: "bundle") pod "627fac7f-354e-4874-aa5e-aba8023f0292" (UID: "627fac7f-354e-4874-aa5e-aba8023f0292"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:20:55.754073 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.754050 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/627fac7f-354e-4874-aa5e-aba8023f0292-kube-api-access-mkcw5" (OuterVolumeSpecName: "kube-api-access-mkcw5") pod "627fac7f-354e-4874-aa5e-aba8023f0292" (UID: "627fac7f-354e-4874-aa5e-aba8023f0292"). InnerVolumeSpecName "kube-api-access-mkcw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:20:55.754436 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.754414 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0de21275-017b-4967-a554-0588860e764b-kube-api-access-f6f5z" (OuterVolumeSpecName: "kube-api-access-f6f5z") pod "0de21275-017b-4967-a554-0588860e764b" (UID: "0de21275-017b-4967-a554-0588860e764b"). InnerVolumeSpecName "kube-api-access-f6f5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:20:55.758214 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.758183 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-util" (OuterVolumeSpecName: "util") pod "0de21275-017b-4967-a554-0588860e764b" (UID: "0de21275-017b-4967-a554-0588860e764b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:20:55.759429 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.759401 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-util" (OuterVolumeSpecName: "util") pod "627fac7f-354e-4874-aa5e-aba8023f0292" (UID: "627fac7f-354e-4874-aa5e-aba8023f0292"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:20:55.853285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.853185 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6f5z\" (UniqueName: \"kubernetes.io/projected/0de21275-017b-4967-a554-0588860e764b-kube-api-access-f6f5z\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:55.853285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.853216 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-util\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:55.853285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.853246 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/627fac7f-354e-4874-aa5e-aba8023f0292-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:55.853285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.853255 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkcw5\" (UniqueName: \"kubernetes.io/projected/627fac7f-354e-4874-aa5e-aba8023f0292-kube-api-access-mkcw5\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:55.853285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.853264 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:55.853285 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:55.853272 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0de21275-017b-4967-a554-0588860e764b-util\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:20:56.447625 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:56.447601 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" Jun 14 19:20:56.447625 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:56.447606 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn" event={"ID":"627fac7f-354e-4874-aa5e-aba8023f0292","Type":"ContainerDied","Data":"a00bfca7602474e9c59f57c8deeaf6817c326cc6ce2268286614411f1f72ee0d"} Jun 14 19:20:56.448075 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:56.447650 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a00bfca7602474e9c59f57c8deeaf6817c326cc6ce2268286614411f1f72ee0d" Jun 14 19:20:56.449592 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:56.449573 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" Jun 14 19:20:56.449702 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:56.449591 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh" event={"ID":"0de21275-017b-4967-a554-0588860e764b","Type":"ContainerDied","Data":"181bbb891ba11c544770492fcd0291340f4d9ba76eacdd514a418b3bf0d57c0c"} Jun 14 19:20:56.449702 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:56.449624 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="181bbb891ba11c544770492fcd0291340f4d9ba76eacdd514a418b3bf0d57c0c" Jun 14 19:20:57.802529 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:20:57.802486 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:01.605100 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:01.605034 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:04.421341 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:04.421305 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:08.460953 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:08.460923 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:09.507659 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:09.507632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:09.832762 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:09.832734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:10.199662 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:10.199585 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:11.407169 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:11.407139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:14.021414 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:14.021367 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:15.275485 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:15.275438 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:16.314564 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:16.314501 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:19.019150 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:19.019104 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:19.118316 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:19.118282 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:19.617528 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:19.617492 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:19.948220 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:19.948187 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:22.604510 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:22.604474 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:22.671535 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:22.671499 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:24.453960 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:24.453919 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:24.515877 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:24.515849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:29.830763 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.830728 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7"] Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831052 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457e8ef8-9990-41e3-858d-f0d8702e40d0" containerName="pull" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831063 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="457e8ef8-9990-41e3-858d-f0d8702e40d0" containerName="pull" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831077 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457e8ef8-9990-41e3-858d-f0d8702e40d0" containerName="extract" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831082 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="457e8ef8-9990-41e3-858d-f0d8702e40d0" containerName="extract" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831090 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457e8ef8-9990-41e3-858d-f0d8702e40d0" containerName="util" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831096 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="457e8ef8-9990-41e3-858d-f0d8702e40d0" containerName="util" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831102 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="627fac7f-354e-4874-aa5e-aba8023f0292" containerName="pull" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831108 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="627fac7f-354e-4874-aa5e-aba8023f0292" containerName="pull" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831113 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0de21275-017b-4967-a554-0588860e764b" containerName="extract" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831118 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0de21275-017b-4967-a554-0588860e764b" containerName="extract" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831130 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07a9cc2-4b57-40a3-85a7-745ed242877e" containerName="pull" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831134 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07a9cc2-4b57-40a3-85a7-745ed242877e" containerName="pull" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831140 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="627fac7f-354e-4874-aa5e-aba8023f0292" containerName="extract" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831145 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="627fac7f-354e-4874-aa5e-aba8023f0292" containerName="extract" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831152 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="627fac7f-354e-4874-aa5e-aba8023f0292" containerName="util" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831157 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="627fac7f-354e-4874-aa5e-aba8023f0292" containerName="util" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831165 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07a9cc2-4b57-40a3-85a7-745ed242877e" containerName="util" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831170 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07a9cc2-4b57-40a3-85a7-745ed242877e" containerName="util" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831176 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07a9cc2-4b57-40a3-85a7-745ed242877e" containerName="extract" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831181 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07a9cc2-4b57-40a3-85a7-745ed242877e" containerName="extract" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831187 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0de21275-017b-4967-a554-0588860e764b" containerName="util" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831192 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0de21275-017b-4967-a554-0588860e764b" containerName="util" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831198 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0de21275-017b-4967-a554-0588860e764b" containerName="pull" Jun 14 19:21:29.831209 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831203 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0de21275-017b-4967-a554-0588860e764b" containerName="pull" Jun 14 19:21:29.831967 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831267 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0de21275-017b-4967-a554-0588860e764b" containerName="extract" Jun 14 19:21:29.831967 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831277 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="627fac7f-354e-4874-aa5e-aba8023f0292" containerName="extract" Jun 14 19:21:29.831967 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831283 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d07a9cc2-4b57-40a3-85a7-745ed242877e" containerName="extract" Jun 14 19:21:29.831967 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.831290 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="457e8ef8-9990-41e3-858d-f0d8702e40d0" containerName="extract" Jun 14 19:21:29.834263 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.834243 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:29.837949 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.837919 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 19:21:29.838082 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.837953 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 19:21:29.840991 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.840644 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dvfvh\"" Jun 14 19:21:29.846460 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.846436 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7"] Jun 14 19:21:29.950396 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.950362 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm2qw\" (UniqueName: \"kubernetes.io/projected/1358f944-e56b-4095-b2c9-fd1ddc1e6150-kube-api-access-fm2qw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d2mw7\" (UID: \"1358f944-e56b-4095-b2c9-fd1ddc1e6150\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:29.950555 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:29.950475 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1358f944-e56b-4095-b2c9-fd1ddc1e6150-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d2mw7\" (UID: \"1358f944-e56b-4095-b2c9-fd1ddc1e6150\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:30.051466 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.051436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm2qw\" (UniqueName: \"kubernetes.io/projected/1358f944-e56b-4095-b2c9-fd1ddc1e6150-kube-api-access-fm2qw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d2mw7\" (UID: \"1358f944-e56b-4095-b2c9-fd1ddc1e6150\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:30.051601 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.051500 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1358f944-e56b-4095-b2c9-fd1ddc1e6150-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d2mw7\" (UID: \"1358f944-e56b-4095-b2c9-fd1ddc1e6150\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:30.051823 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.051807 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1358f944-e56b-4095-b2c9-fd1ddc1e6150-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d2mw7\" (UID: \"1358f944-e56b-4095-b2c9-fd1ddc1e6150\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:30.059251 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.059216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm2qw\" (UniqueName: \"kubernetes.io/projected/1358f944-e56b-4095-b2c9-fd1ddc1e6150-kube-api-access-fm2qw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d2mw7\" (UID: \"1358f944-e56b-4095-b2c9-fd1ddc1e6150\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:30.145097 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.145028 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:30.310482 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.310458 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7"] Jun 14 19:21:30.312313 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:21:30.312279 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1358f944_e56b_4095_b2c9_fd1ddc1e6150.slice/crio-c52f19ff224223c3c8c36b7bb38e735d1b412ecd0a781bb4c9af0e210754f616 WatchSource:0}: Error finding container c52f19ff224223c3c8c36b7bb38e735d1b412ecd0a781bb4c9af0e210754f616: Status 404 returned error can't find the container with id c52f19ff224223c3c8c36b7bb38e735d1b412ecd0a781bb4c9af0e210754f616 Jun 14 19:21:30.494330 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.494252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:30.591653 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.591626 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:30.603793 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.603762 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7"] Jun 14 19:21:30.608015 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.607990 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7"] Jun 14 19:21:30.647372 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.647332 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m"] Jun 14 19:21:30.652600 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.652573 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:30.682702 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.682666 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m"] Jun 14 19:21:30.759146 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.759066 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhjj8\" (UniqueName: \"kubernetes.io/projected/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-kube-api-access-zhjj8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n788m\" (UID: \"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:30.759332 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.759196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n788m\" (UID: \"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:30.860454 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.860421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhjj8\" (UniqueName: \"kubernetes.io/projected/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-kube-api-access-zhjj8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n788m\" (UID: \"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:30.860876 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.860592 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n788m\" (UID: \"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:30.860944 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.860904 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n788m\" (UID: \"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:30.876045 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.876016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhjj8\" (UniqueName: \"kubernetes.io/projected/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-kube-api-access-zhjj8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n788m\" (UID: \"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:30.965965 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:30.965926 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:31.502530 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:31.502500 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m"] Jun 14 19:21:31.542341 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:21:31.542293 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5d2f98_8c32_4d40_b851_cc0b49fc3b7b.slice/crio-5e4300c0b5f42ae4630d1c895c66bb56284e8a253d8712df66134780f964746e WatchSource:0}: Error finding container 5e4300c0b5f42ae4630d1c895c66bb56284e8a253d8712df66134780f964746e: Status 404 returned error can't find the container with id 5e4300c0b5f42ae4630d1c895c66bb56284e8a253d8712df66134780f964746e Jun 14 19:21:31.648759 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:31.648679 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" event={"ID":"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b","Type":"ContainerStarted","Data":"5e4300c0b5f42ae4630d1c895c66bb56284e8a253d8712df66134780f964746e"} Jun 14 19:21:33.058372 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:33.058337 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:33.159152 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:33.159112 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:35.677473 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:35.677422 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" podUID="1358f944-e56b-4095-b2c9-fd1ddc1e6150" containerName="manager" containerID="cri-o://75b58b4df7cd01508b54c0126693ebb67af6f0b7303e2ccf37b763b7ce907eb7" gracePeriod=2 Jun 14 19:21:35.679270 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:35.679212 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" event={"ID":"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b","Type":"ContainerStarted","Data":"07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde"} Jun 14 19:21:35.679406 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:35.679389 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:35.699994 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:35.699948 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" podStartSLOduration=2.256213623 podStartE2EDuration="5.699934266s" totalImagesPullingTime="3.443720643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:21:35.697012058 +0000 UTC m=+594.907943014" watchObservedRunningTime="2026-06-14 19:21:35.699934266 +0000 UTC m=+594.910865222" Jun 14 19:21:35.875457 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:35.875421 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:35.919781 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:35.919761 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:35.921568 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:21:35.921540 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-d2mw7\" is forbidden: User \"system:node:ip-10-0-133-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-27.ec2.internal' and this object" podUID="1358f944-e56b-4095-b2c9-fd1ddc1e6150" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:35.978533 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:35.978469 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:36.008616 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:36.008595 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm2qw\" (UniqueName: \"kubernetes.io/projected/1358f944-e56b-4095-b2c9-fd1ddc1e6150-kube-api-access-fm2qw\") pod \"1358f944-e56b-4095-b2c9-fd1ddc1e6150\" (UID: \"1358f944-e56b-4095-b2c9-fd1ddc1e6150\") " Jun 14 19:21:36.008734 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:36.008695 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1358f944-e56b-4095-b2c9-fd1ddc1e6150-extensions-socket-volume\") pod \"1358f944-e56b-4095-b2c9-fd1ddc1e6150\" (UID: \"1358f944-e56b-4095-b2c9-fd1ddc1e6150\") " Jun 14 19:21:36.008964 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:36.008939 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1358f944-e56b-4095-b2c9-fd1ddc1e6150-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1358f944-e56b-4095-b2c9-fd1ddc1e6150" (UID: "1358f944-e56b-4095-b2c9-fd1ddc1e6150"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:21:36.010677 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:36.010649 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1358f944-e56b-4095-b2c9-fd1ddc1e6150-kube-api-access-fm2qw" (OuterVolumeSpecName: "kube-api-access-fm2qw") pod "1358f944-e56b-4095-b2c9-fd1ddc1e6150" (UID: "1358f944-e56b-4095-b2c9-fd1ddc1e6150"). InnerVolumeSpecName "kube-api-access-fm2qw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:21:36.109414 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:36.109388 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1358f944-e56b-4095-b2c9-fd1ddc1e6150-extensions-socket-volume\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:21:36.109414 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:36.109410 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm2qw\" (UniqueName: \"kubernetes.io/projected/1358f944-e56b-4095-b2c9-fd1ddc1e6150-kube-api-access-fm2qw\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:21:36.686767 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:36.686736 2559 generic.go:356] "Generic (PLEG): container finished" podID="1358f944-e56b-4095-b2c9-fd1ddc1e6150" containerID="75b58b4df7cd01508b54c0126693ebb67af6f0b7303e2ccf37b763b7ce907eb7" exitCode=2 Jun 14 19:21:36.687203 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:36.686781 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:36.687203 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:36.686834 2559 scope.go:117] "RemoveContainer" containerID="75b58b4df7cd01508b54c0126693ebb67af6f0b7303e2ccf37b763b7ce907eb7" Jun 14 19:21:36.688706 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:21:36.688674 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-d2mw7\" is forbidden: User \"system:node:ip-10-0-133-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-27.ec2.internal' and this object" podUID="1358f944-e56b-4095-b2c9-fd1ddc1e6150" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:36.695989 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:36.695958 2559 scope.go:117] "RemoveContainer" containerID="75b58b4df7cd01508b54c0126693ebb67af6f0b7303e2ccf37b763b7ce907eb7" Jun 14 19:21:36.696068 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:21:36.696039 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-d2mw7\" is forbidden: User \"system:node:ip-10-0-133-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-27.ec2.internal' and this object" podUID="1358f944-e56b-4095-b2c9-fd1ddc1e6150" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d2mw7" Jun 14 19:21:36.696214 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:21:36.696197 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75b58b4df7cd01508b54c0126693ebb67af6f0b7303e2ccf37b763b7ce907eb7\": container with ID starting with 75b58b4df7cd01508b54c0126693ebb67af6f0b7303e2ccf37b763b7ce907eb7 not found: ID does not exist" containerID="75b58b4df7cd01508b54c0126693ebb67af6f0b7303e2ccf37b763b7ce907eb7" Jun 14 19:21:36.696291 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:36.696251 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75b58b4df7cd01508b54c0126693ebb67af6f0b7303e2ccf37b763b7ce907eb7"} err="failed to get container status \"75b58b4df7cd01508b54c0126693ebb67af6f0b7303e2ccf37b763b7ce907eb7\": rpc error: code = NotFound desc = could not find container \"75b58b4df7cd01508b54c0126693ebb67af6f0b7303e2ccf37b763b7ce907eb7\": container with ID starting with 75b58b4df7cd01508b54c0126693ebb67af6f0b7303e2ccf37b763b7ce907eb7 not found: ID does not exist" Jun 14 19:21:37.265878 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:37.265845 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1358f944-e56b-4095-b2c9-fd1ddc1e6150" path="/var/lib/kubelet/pods/1358f944-e56b-4095-b2c9-fd1ddc1e6150/volumes" Jun 14 19:21:39.399435 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:39.399398 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:39.499033 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:39.499004 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:41.238391 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:41.238363 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:21:41.241673 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:41.241653 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:21:41.243287 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:41.243270 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:21:41.246075 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:41.246056 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:21:46.689061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:46.689026 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:46.980600 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:46.980572 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54"] Jun 14 19:21:46.980915 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:46.980903 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1358f944-e56b-4095-b2c9-fd1ddc1e6150" containerName="manager" Jun 14 19:21:46.980959 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:46.980917 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1358f944-e56b-4095-b2c9-fd1ddc1e6150" containerName="manager" Jun 14 19:21:46.980994 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:46.980972 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1358f944-e56b-4095-b2c9-fd1ddc1e6150" containerName="manager" Jun 14 19:21:46.983867 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:46.983852 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" Jun 14 19:21:46.995753 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:46.995727 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54"] Jun 14 19:21:47.104163 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.104133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a295ca7-f91a-461d-9e17-2c0bbab1b657-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jkg54\" (UID: \"1a295ca7-f91a-461d-9e17-2c0bbab1b657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" Jun 14 19:21:47.104355 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.104180 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t66qp\" (UniqueName: \"kubernetes.io/projected/1a295ca7-f91a-461d-9e17-2c0bbab1b657-kube-api-access-t66qp\") pod \"kuadrant-operator-controller-manager-86878c769f-jkg54\" (UID: \"1a295ca7-f91a-461d-9e17-2c0bbab1b657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" Jun 14 19:21:47.204941 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.204916 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a295ca7-f91a-461d-9e17-2c0bbab1b657-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jkg54\" (UID: \"1a295ca7-f91a-461d-9e17-2c0bbab1b657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" Jun 14 19:21:47.205087 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.204959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t66qp\" (UniqueName: \"kubernetes.io/projected/1a295ca7-f91a-461d-9e17-2c0bbab1b657-kube-api-access-t66qp\") pod \"kuadrant-operator-controller-manager-86878c769f-jkg54\" (UID: \"1a295ca7-f91a-461d-9e17-2c0bbab1b657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" Jun 14 19:21:47.205282 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.205265 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a295ca7-f91a-461d-9e17-2c0bbab1b657-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jkg54\" (UID: \"1a295ca7-f91a-461d-9e17-2c0bbab1b657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" Jun 14 19:21:47.215909 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.215884 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t66qp\" (UniqueName: \"kubernetes.io/projected/1a295ca7-f91a-461d-9e17-2c0bbab1b657-kube-api-access-t66qp\") pod \"kuadrant-operator-controller-manager-86878c769f-jkg54\" (UID: \"1a295ca7-f91a-461d-9e17-2c0bbab1b657\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" Jun 14 19:21:47.294422 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.294404 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" Jun 14 19:21:47.426779 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.426750 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54"] Jun 14 19:21:47.430363 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:21:47.430334 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a295ca7_f91a_461d_9e17_2c0bbab1b657.slice/crio-eb29c8b03ffee72086c433d0f3fbf7b9f8b96aa2794c3e288a44a2fa37551f91 WatchSource:0}: Error finding container eb29c8b03ffee72086c433d0f3fbf7b9f8b96aa2794c3e288a44a2fa37551f91: Status 404 returned error can't find the container with id eb29c8b03ffee72086c433d0f3fbf7b9f8b96aa2794c3e288a44a2fa37551f91 Jun 14 19:21:47.750051 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.749960 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" event={"ID":"1a295ca7-f91a-461d-9e17-2c0bbab1b657","Type":"ContainerStarted","Data":"cf9e9456431a47457b2a2bd571949afad5c2c7a8845c2ba173090487573d5a1d"} Jun 14 19:21:47.750051 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.750017 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" event={"ID":"1a295ca7-f91a-461d-9e17-2c0bbab1b657","Type":"ContainerStarted","Data":"eb29c8b03ffee72086c433d0f3fbf7b9f8b96aa2794c3e288a44a2fa37551f91"} Jun 14 19:21:47.750480 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.750074 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" Jun 14 19:21:47.779302 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:47.776208 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" podStartSLOduration=1.776181858 podStartE2EDuration="1.776181858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:21:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:21:47.772245695 +0000 UTC m=+606.983176649" watchObservedRunningTime="2026-06-14 19:21:47.776181858 +0000 UTC m=+606.987112816" Jun 14 19:21:48.248509 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:48.248469 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:48.347840 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:48.347805 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:48.454541 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:48.454510 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:50.844176 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:50.844142 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:50.952294 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:50.952261 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:54.044503 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:54.044441 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:54.145917 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:54.145890 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:57.441352 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:57.441314 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:57.499169 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:57.499146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:21:58.758595 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:58.758560 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jkg54" Jun 14 19:21:58.809342 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:58.809311 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m"] Jun 14 19:21:58.809572 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:58.809548 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" podUID="8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b" containerName="manager" containerID="cri-o://07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde" gracePeriod=10 Jun 14 19:21:59.055443 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.055411 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:59.105796 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.105765 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-extensions-socket-volume\") pod \"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b\" (UID: \"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b\") " Jun 14 19:21:59.105953 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.105831 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhjj8\" (UniqueName: \"kubernetes.io/projected/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-kube-api-access-zhjj8\") pod \"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b\" (UID: \"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b\") " Jun 14 19:21:59.106164 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.106139 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b" (UID: "8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:21:59.107757 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.107734 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-kube-api-access-zhjj8" (OuterVolumeSpecName: "kube-api-access-zhjj8") pod "8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b" (UID: "8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b"). InnerVolumeSpecName "kube-api-access-zhjj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:21:59.206776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.206745 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhjj8\" (UniqueName: \"kubernetes.io/projected/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-kube-api-access-zhjj8\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:21:59.206776 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.206772 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b-extensions-socket-volume\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:21:59.817496 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.817465 2559 generic.go:356] "Generic (PLEG): container finished" podID="8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b" containerID="07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde" exitCode=0 Jun 14 19:21:59.817897 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.817503 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" Jun 14 19:21:59.817897 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.817543 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" event={"ID":"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b","Type":"ContainerDied","Data":"07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde"} Jun 14 19:21:59.817897 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.817591 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m" event={"ID":"8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b","Type":"ContainerDied","Data":"5e4300c0b5f42ae4630d1c895c66bb56284e8a253d8712df66134780f964746e"} Jun 14 19:21:59.817897 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.817614 2559 scope.go:117] "RemoveContainer" containerID="07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde" Jun 14 19:21:59.826584 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.826564 2559 scope.go:117] "RemoveContainer" containerID="07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde" Jun 14 19:21:59.826830 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:21:59.826807 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde\": container with ID starting with 07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde not found: ID does not exist" containerID="07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde" Jun 14 19:21:59.826903 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.826837 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde"} err="failed to get container status \"07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde\": rpc error: code = NotFound desc = could not find container \"07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde\": container with ID starting with 07ac007224d93a6794afe740d70723a5fe248e235675092fa3b0692780eb4dde not found: ID does not exist" Jun 14 19:21:59.835057 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.835033 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m"] Jun 14 19:21:59.840868 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:21:59.840849 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n788m"] Jun 14 19:22:01.270517 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:01.270483 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b" path="/var/lib/kubelet/pods/8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b/volumes" Jun 14 19:22:03.136012 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:03.135979 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:03.399122 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:03.399051 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:06.318113 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:06.318079 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:06.374267 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:06.374213 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:06.451235 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:06.451192 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:06.569613 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:06.569535 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:07.041604 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:07.041524 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:07.097877 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:07.097853 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:08.239032 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:08.238994 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:08.296278 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:08.296250 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:17.267628 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:17.267598 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787497b4d4-8fvzx"] Jun 14 19:22:17.377276 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:17.377218 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:17.474629 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:17.474598 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:17.575559 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:17.575533 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:19.122711 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.122674 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wtlkd"] Jun 14 19:22:19.123216 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.123197 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b" containerName="manager" Jun 14 19:22:19.123216 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.123217 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b" containerName="manager" Jun 14 19:22:19.123347 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.123299 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e5d2f98-8c32-4d40-b851-cc0b49fc3b7b" containerName="manager" Jun 14 19:22:19.127404 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.127387 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:19.129585 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.129562 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 19:22:19.129687 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.129657 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s865v\"" Jun 14 19:22:19.130813 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.130793 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:19.135573 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.135552 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wtlkd"] Jun 14 19:22:19.167103 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.167074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkmdg\" (UniqueName: \"kubernetes.io/projected/60de31ad-e75c-4b28-87fd-79897c07bf39-kube-api-access-mkmdg\") pod \"limitador-limitador-64c94fd64f-wtlkd\" (UID: \"60de31ad-e75c-4b28-87fd-79897c07bf39\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:19.167243 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.167136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60de31ad-e75c-4b28-87fd-79897c07bf39-config-file\") pod \"limitador-limitador-64c94fd64f-wtlkd\" (UID: \"60de31ad-e75c-4b28-87fd-79897c07bf39\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:19.221398 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.221364 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wtlkd"] Jun 14 19:22:19.239949 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.239917 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:19.268239 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.268201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkmdg\" (UniqueName: \"kubernetes.io/projected/60de31ad-e75c-4b28-87fd-79897c07bf39-kube-api-access-mkmdg\") pod \"limitador-limitador-64c94fd64f-wtlkd\" (UID: \"60de31ad-e75c-4b28-87fd-79897c07bf39\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:19.268397 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.268252 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60de31ad-e75c-4b28-87fd-79897c07bf39-config-file\") pod \"limitador-limitador-64c94fd64f-wtlkd\" (UID: \"60de31ad-e75c-4b28-87fd-79897c07bf39\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:19.268874 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.268856 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60de31ad-e75c-4b28-87fd-79897c07bf39-config-file\") pod \"limitador-limitador-64c94fd64f-wtlkd\" (UID: \"60de31ad-e75c-4b28-87fd-79897c07bf39\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:19.275907 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.275884 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkmdg\" (UniqueName: \"kubernetes.io/projected/60de31ad-e75c-4b28-87fd-79897c07bf39-kube-api-access-mkmdg\") pod \"limitador-limitador-64c94fd64f-wtlkd\" (UID: \"60de31ad-e75c-4b28-87fd-79897c07bf39\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:19.304146 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.304125 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:19.439540 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.439273 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:19.574080 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.573995 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wtlkd"] Jun 14 19:22:19.576650 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:22:19.576612 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60de31ad_e75c_4b28_87fd_79897c07bf39.slice/crio-8ae8fa0a7ffd15cfef2ab83b082e68750d794ea944579adae03de60393ba6f94 WatchSource:0}: Error finding container 8ae8fa0a7ffd15cfef2ab83b082e68750d794ea944579adae03de60393ba6f94: Status 404 returned error can't find the container with id 8ae8fa0a7ffd15cfef2ab83b082e68750d794ea944579adae03de60393ba6f94 Jun 14 19:22:19.578804 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.578788 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 19:22:19.926441 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.926410 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" event={"ID":"60de31ad-e75c-4b28-87fd-79897c07bf39","Type":"ContainerStarted","Data":"8ae8fa0a7ffd15cfef2ab83b082e68750d794ea944579adae03de60393ba6f94"} Jun 14 19:22:19.960123 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:19.960091 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:20.015154 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:20.015128 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:22.945116 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:22.945083 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" event={"ID":"60de31ad-e75c-4b28-87fd-79897c07bf39","Type":"ContainerStarted","Data":"ba81d0c2040dcaa0821d8c57e80709af26fe20beb0956e4a2489292f3b37743c"} Jun 14 19:22:22.945522 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:22.945152 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:22.961630 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:22.961580 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" podStartSLOduration=1.359325092 podStartE2EDuration="3.961566301s" totalImagesPullingTime="2.602241209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:22:22.959783963 +0000 UTC m=+642.170714945" watchObservedRunningTime="2026-06-14 19:22:22.961566301 +0000 UTC m=+642.172497257" Jun 14 19:22:33.951858 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:33.951830 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:34.281585 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:34.281496 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wtlkd"] Jun 14 19:22:34.282008 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:34.281953 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" podUID="60de31ad-e75c-4b28-87fd-79897c07bf39" containerName="limitador" containerID="cri-o://ba81d0c2040dcaa0821d8c57e80709af26fe20beb0956e4a2489292f3b37743c" gracePeriod=30 Jun 14 19:22:35.011282 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:35.011182 2559 generic.go:356] "Generic (PLEG): container finished" podID="60de31ad-e75c-4b28-87fd-79897c07bf39" containerID="ba81d0c2040dcaa0821d8c57e80709af26fe20beb0956e4a2489292f3b37743c" exitCode=0 Jun 14 19:22:35.011282 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:35.011254 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" event={"ID":"60de31ad-e75c-4b28-87fd-79897c07bf39","Type":"ContainerDied","Data":"ba81d0c2040dcaa0821d8c57e80709af26fe20beb0956e4a2489292f3b37743c"} Jun 14 19:22:35.232002 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:35.231981 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:35.304029 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:35.304007 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkmdg\" (UniqueName: \"kubernetes.io/projected/60de31ad-e75c-4b28-87fd-79897c07bf39-kube-api-access-mkmdg\") pod \"60de31ad-e75c-4b28-87fd-79897c07bf39\" (UID: \"60de31ad-e75c-4b28-87fd-79897c07bf39\") " Jun 14 19:22:35.304164 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:35.304077 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60de31ad-e75c-4b28-87fd-79897c07bf39-config-file\") pod \"60de31ad-e75c-4b28-87fd-79897c07bf39\" (UID: \"60de31ad-e75c-4b28-87fd-79897c07bf39\") " Jun 14 19:22:35.304425 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:35.304403 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60de31ad-e75c-4b28-87fd-79897c07bf39-config-file" (OuterVolumeSpecName: "config-file") pod "60de31ad-e75c-4b28-87fd-79897c07bf39" (UID: "60de31ad-e75c-4b28-87fd-79897c07bf39"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:22:35.306078 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:35.306052 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60de31ad-e75c-4b28-87fd-79897c07bf39-kube-api-access-mkmdg" (OuterVolumeSpecName: "kube-api-access-mkmdg") pod "60de31ad-e75c-4b28-87fd-79897c07bf39" (UID: "60de31ad-e75c-4b28-87fd-79897c07bf39"). InnerVolumeSpecName "kube-api-access-mkmdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:22:35.405588 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:35.405558 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkmdg\" (UniqueName: \"kubernetes.io/projected/60de31ad-e75c-4b28-87fd-79897c07bf39-kube-api-access-mkmdg\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:35.405588 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:35.405585 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60de31ad-e75c-4b28-87fd-79897c07bf39-config-file\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:36.017693 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.017662 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" Jun 14 19:22:36.018105 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.017706 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wtlkd" event={"ID":"60de31ad-e75c-4b28-87fd-79897c07bf39","Type":"ContainerDied","Data":"8ae8fa0a7ffd15cfef2ab83b082e68750d794ea944579adae03de60393ba6f94"} Jun 14 19:22:36.018105 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.017767 2559 scope.go:117] "RemoveContainer" containerID="ba81d0c2040dcaa0821d8c57e80709af26fe20beb0956e4a2489292f3b37743c" Jun 14 19:22:36.040752 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.040729 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wtlkd"] Jun 14 19:22:36.042991 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.042971 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wtlkd"] Jun 14 19:22:36.881463 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.881432 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-g9klx"] Jun 14 19:22:36.881969 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.881952 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60de31ad-e75c-4b28-87fd-79897c07bf39" containerName="limitador" Jun 14 19:22:36.882019 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.881974 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="60de31ad-e75c-4b28-87fd-79897c07bf39" containerName="limitador" Jun 14 19:22:36.882104 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.882075 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="60de31ad-e75c-4b28-87fd-79897c07bf39" containerName="limitador" Jun 14 19:22:36.892567 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.892542 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-g9klx" Jun 14 19:22:36.895438 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.895416 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 14 19:22:36.899399 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.899369 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-g9klx"] Jun 14 19:22:36.920709 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:36.920686 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:37.018524 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:37.018491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htj7h\" (UniqueName: \"kubernetes.io/projected/271a7f07-8fb7-4d38-bfcb-2c8564bc64d5-kube-api-access-htj7h\") pod \"postgres-69fb4594cf-g9klx\" (UID: \"271a7f07-8fb7-4d38-bfcb-2c8564bc64d5\") " pod="opendatahub/postgres-69fb4594cf-g9klx" Jun 14 19:22:37.018871 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:37.018572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/271a7f07-8fb7-4d38-bfcb-2c8564bc64d5-data\") pod \"postgres-69fb4594cf-g9klx\" (UID: \"271a7f07-8fb7-4d38-bfcb-2c8564bc64d5\") " pod="opendatahub/postgres-69fb4594cf-g9klx" Jun 14 19:22:37.119764 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:37.119734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htj7h\" (UniqueName: \"kubernetes.io/projected/271a7f07-8fb7-4d38-bfcb-2c8564bc64d5-kube-api-access-htj7h\") pod \"postgres-69fb4594cf-g9klx\" (UID: \"271a7f07-8fb7-4d38-bfcb-2c8564bc64d5\") " pod="opendatahub/postgres-69fb4594cf-g9klx" Jun 14 19:22:37.119922 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:37.119785 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/271a7f07-8fb7-4d38-bfcb-2c8564bc64d5-data\") pod \"postgres-69fb4594cf-g9klx\" (UID: \"271a7f07-8fb7-4d38-bfcb-2c8564bc64d5\") " pod="opendatahub/postgres-69fb4594cf-g9klx" Jun 14 19:22:37.120199 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:37.120182 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/271a7f07-8fb7-4d38-bfcb-2c8564bc64d5-data\") pod \"postgres-69fb4594cf-g9klx\" (UID: \"271a7f07-8fb7-4d38-bfcb-2c8564bc64d5\") " pod="opendatahub/postgres-69fb4594cf-g9klx" Jun 14 19:22:37.128031 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:37.128000 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htj7h\" (UniqueName: \"kubernetes.io/projected/271a7f07-8fb7-4d38-bfcb-2c8564bc64d5-kube-api-access-htj7h\") pod \"postgres-69fb4594cf-g9klx\" (UID: \"271a7f07-8fb7-4d38-bfcb-2c8564bc64d5\") " pod="opendatahub/postgres-69fb4594cf-g9klx" Jun 14 19:22:37.205682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:37.205608 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-g9klx" Jun 14 19:22:37.269004 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:37.268973 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60de31ad-e75c-4b28-87fd-79897c07bf39" path="/var/lib/kubelet/pods/60de31ad-e75c-4b28-87fd-79897c07bf39/volumes" Jun 14 19:22:37.334614 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:37.334459 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-g9klx"] Jun 14 19:22:37.336860 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:22:37.336816 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod271a7f07_8fb7_4d38_bfcb_2c8564bc64d5.slice/crio-2db1bd8ffb75318d57e3a8848c27dd951e24a9df8e2ab9555164f9346034b98c WatchSource:0}: Error finding container 2db1bd8ffb75318d57e3a8848c27dd951e24a9df8e2ab9555164f9346034b98c: Status 404 returned error can't find the container with id 2db1bd8ffb75318d57e3a8848c27dd951e24a9df8e2ab9555164f9346034b98c Jun 14 19:22:38.032113 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:38.032077 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-g9klx" event={"ID":"271a7f07-8fb7-4d38-bfcb-2c8564bc64d5","Type":"ContainerStarted","Data":"2db1bd8ffb75318d57e3a8848c27dd951e24a9df8e2ab9555164f9346034b98c"} Jun 14 19:22:40.046033 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:40.045995 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-g9klx" event={"ID":"271a7f07-8fb7-4d38-bfcb-2c8564bc64d5","Type":"ContainerStarted","Data":"d49c93cc8cd212d0bb9438b77a065be948a28fb0c4356e109f12b8ca76f9a1d9"} Jun 14 19:22:40.046523 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:40.046144 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-g9klx" Jun 14 19:22:40.061140 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:40.061093 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-g9klx" podStartSLOduration=2.064444464 podStartE2EDuration="4.061078409s" totalImagesPullingTime="1.996633945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:22:40.058214114 +0000 UTC m=+659.269145084" watchObservedRunningTime="2026-06-14 19:22:40.061078409 +0000 UTC m=+659.272009365" Jun 14 19:22:40.405914 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:40.405835 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:42.289483 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.289437 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-787497b4d4-8fvzx" podUID="330888b5-c6d8-48ba-96c5-f4b1cdb89364" containerName="console" containerID="cri-o://218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8" gracePeriod=15 Jun 14 19:22:42.550390 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.550365 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:22:42.666973 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.666943 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-oauth-config\") pod \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " Jun 14 19:22:42.667149 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.666993 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-config\") pod \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " Jun 14 19:22:42.667149 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.667052 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-oauth-serving-cert\") pod \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " Jun 14 19:22:42.667149 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.667069 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-service-ca\") pod \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " Jun 14 19:22:42.667149 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.667104 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-trusted-ca-bundle\") pod \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " Jun 14 19:22:42.667149 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.667128 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-serving-cert\") pod \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " Jun 14 19:22:42.667462 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.667160 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnl4h\" (UniqueName: \"kubernetes.io/projected/330888b5-c6d8-48ba-96c5-f4b1cdb89364-kube-api-access-qnl4h\") pod \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\" (UID: \"330888b5-c6d8-48ba-96c5-f4b1cdb89364\") " Jun 14 19:22:42.667551 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.667521 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-config" (OuterVolumeSpecName: "console-config") pod "330888b5-c6d8-48ba-96c5-f4b1cdb89364" (UID: "330888b5-c6d8-48ba-96c5-f4b1cdb89364"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:22:42.667611 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.667551 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "330888b5-c6d8-48ba-96c5-f4b1cdb89364" (UID: "330888b5-c6d8-48ba-96c5-f4b1cdb89364"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:22:42.667611 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.667568 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-service-ca" (OuterVolumeSpecName: "service-ca") pod "330888b5-c6d8-48ba-96c5-f4b1cdb89364" (UID: "330888b5-c6d8-48ba-96c5-f4b1cdb89364"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:22:42.667702 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.667603 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "330888b5-c6d8-48ba-96c5-f4b1cdb89364" (UID: "330888b5-c6d8-48ba-96c5-f4b1cdb89364"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 19:22:42.669260 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.669215 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "330888b5-c6d8-48ba-96c5-f4b1cdb89364" (UID: "330888b5-c6d8-48ba-96c5-f4b1cdb89364"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 19:22:42.669371 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.669256 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "330888b5-c6d8-48ba-96c5-f4b1cdb89364" (UID: "330888b5-c6d8-48ba-96c5-f4b1cdb89364"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 19:22:42.669446 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.669430 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/330888b5-c6d8-48ba-96c5-f4b1cdb89364-kube-api-access-qnl4h" (OuterVolumeSpecName: "kube-api-access-qnl4h") pod "330888b5-c6d8-48ba-96c5-f4b1cdb89364" (UID: "330888b5-c6d8-48ba-96c5-f4b1cdb89364"). InnerVolumeSpecName "kube-api-access-qnl4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:22:42.768381 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.768349 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnl4h\" (UniqueName: \"kubernetes.io/projected/330888b5-c6d8-48ba-96c5-f4b1cdb89364-kube-api-access-qnl4h\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:42.768381 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.768375 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-oauth-config\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:42.768381 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.768385 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-config\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:42.768613 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.768395 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-oauth-serving-cert\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:42.768613 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.768404 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-service-ca\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:42.768613 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.768412 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/330888b5-c6d8-48ba-96c5-f4b1cdb89364-trusted-ca-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:42.768613 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:42.768421 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/330888b5-c6d8-48ba-96c5-f4b1cdb89364-console-serving-cert\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:43.062954 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:43.062922 2559 generic.go:356] "Generic (PLEG): container finished" podID="330888b5-c6d8-48ba-96c5-f4b1cdb89364" containerID="218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8" exitCode=0 Jun 14 19:22:43.063156 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:43.062964 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787497b4d4-8fvzx" Jun 14 19:22:43.063156 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:43.063014 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787497b4d4-8fvzx" event={"ID":"330888b5-c6d8-48ba-96c5-f4b1cdb89364","Type":"ContainerDied","Data":"218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8"} Jun 14 19:22:43.063156 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:43.063069 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787497b4d4-8fvzx" event={"ID":"330888b5-c6d8-48ba-96c5-f4b1cdb89364","Type":"ContainerDied","Data":"9562e272eb0011f61c14e6b11583d9889c96af2d38dd8fd3703e9f7783ee06dd"} Jun 14 19:22:43.063156 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:43.063098 2559 scope.go:117] "RemoveContainer" containerID="218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8" Jun 14 19:22:43.072206 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:43.072186 2559 scope.go:117] "RemoveContainer" containerID="218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8" Jun 14 19:22:43.072531 ip-10-0-133-27 kubenswrapper[2559]: E0614 19:22:43.072514 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8\": container with ID starting with 218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8 not found: ID does not exist" containerID="218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8" Jun 14 19:22:43.072600 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:43.072544 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8"} err="failed to get container status \"218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8\": rpc error: code = NotFound desc = could not find container \"218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8\": container with ID starting with 218d6eaf9d2ce39edab18d426ccf71b06cc34b0c1b7e6957e3cf24dd28db46d8 not found: ID does not exist" Jun 14 19:22:43.083497 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:43.083470 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787497b4d4-8fvzx"] Jun 14 19:22:43.086853 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:43.086824 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-787497b4d4-8fvzx"] Jun 14 19:22:43.266066 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:43.266033 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="330888b5-c6d8-48ba-96c5-f4b1cdb89364" path="/var/lib/kubelet/pods/330888b5-c6d8-48ba-96c5-f4b1cdb89364/volumes" Jun 14 19:22:46.084543 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:46.084514 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-g9klx" Jun 14 19:22:46.371748 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:46.371670 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:46.477316 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:46.477280 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:46.649683 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:46.649595 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:22:47.484636 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.484597 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj"] Jun 14 19:22:47.485008 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.484939 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="330888b5-c6d8-48ba-96c5-f4b1cdb89364" containerName="console" Jun 14 19:22:47.485008 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.484951 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="330888b5-c6d8-48ba-96c5-f4b1cdb89364" containerName="console" Jun 14 19:22:47.485077 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.485027 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="330888b5-c6d8-48ba-96c5-f4b1cdb89364" containerName="console" Jun 14 19:22:47.491388 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.491365 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:47.494069 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.494047 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 19:22:47.494293 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.494070 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f4nrq\"" Jun 14 19:22:47.494412 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.494193 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 19:22:47.496170 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.496148 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj"] Jun 14 19:22:47.610900 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.610869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:47.611108 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.610913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:47.611108 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.610955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-779n9\" (UniqueName: \"kubernetes.io/projected/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-kube-api-access-779n9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:47.711658 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.711622 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:47.711806 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.711689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-779n9\" (UniqueName: \"kubernetes.io/projected/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-kube-api-access-779n9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:47.711806 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.711761 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:47.712089 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.712069 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:47.712128 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.712080 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:47.720089 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.720056 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-779n9\" (UniqueName: \"kubernetes.io/projected/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-kube-api-access-779n9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:47.802930 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.802905 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:47.935076 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:47.935047 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj"] Jun 14 19:22:47.936416 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:22:47.936390 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb81e2d_e767_4c59_84e5_a5ad6fbffdfa.slice/crio-26e97759bcce3bbee81da32e30d9603d73eac1e619ba1672a56280b31e7ee850 WatchSource:0}: Error finding container 26e97759bcce3bbee81da32e30d9603d73eac1e619ba1672a56280b31e7ee850: Status 404 returned error can't find the container with id 26e97759bcce3bbee81da32e30d9603d73eac1e619ba1672a56280b31e7ee850 Jun 14 19:22:48.093140 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:48.093073 2559 generic.go:356] "Generic (PLEG): container finished" podID="7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" containerID="8fff7e38b5a5e93a6760a2863eb77f9f558e6faacec8b8ac3d953009bb40a187" exitCode=0 Jun 14 19:22:48.093268 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:48.093139 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" event={"ID":"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa","Type":"ContainerDied","Data":"8fff7e38b5a5e93a6760a2863eb77f9f558e6faacec8b8ac3d953009bb40a187"} Jun 14 19:22:48.093268 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:48.093186 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" event={"ID":"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa","Type":"ContainerStarted","Data":"26e97759bcce3bbee81da32e30d9603d73eac1e619ba1672a56280b31e7ee850"} Jun 14 19:22:49.101157 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:49.101125 2559 generic.go:356] "Generic (PLEG): container finished" podID="7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" containerID="5b19293403c330a0c0301bd588e86422719a2b38c57b55ce4dac996a58df93f7" exitCode=0 Jun 14 19:22:49.101558 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:49.101194 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" event={"ID":"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa","Type":"ContainerDied","Data":"5b19293403c330a0c0301bd588e86422719a2b38c57b55ce4dac996a58df93f7"} Jun 14 19:22:50.108526 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:50.108488 2559 generic.go:356] "Generic (PLEG): container finished" podID="7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" containerID="dab21514b7c8cc1273291ceaa2b324f1b75fd0b9419d7c0891d8b45c44d8fac8" exitCode=0 Jun 14 19:22:50.109011 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:50.108549 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" event={"ID":"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa","Type":"ContainerDied","Data":"dab21514b7c8cc1273291ceaa2b324f1b75fd0b9419d7c0891d8b45c44d8fac8"} Jun 14 19:22:51.247006 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:51.246974 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:51.342069 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:51.342042 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-bundle\") pod \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " Jun 14 19:22:51.342207 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:51.342076 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-779n9\" (UniqueName: \"kubernetes.io/projected/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-kube-api-access-779n9\") pod \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " Jun 14 19:22:51.342207 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:51.342093 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-util\") pod \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\" (UID: \"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa\") " Jun 14 19:22:51.342674 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:51.342643 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-bundle" (OuterVolumeSpecName: "bundle") pod "7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" (UID: "7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:22:51.344064 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:51.344039 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-kube-api-access-779n9" (OuterVolumeSpecName: "kube-api-access-779n9") pod "7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" (UID: "7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa"). InnerVolumeSpecName "kube-api-access-779n9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:22:51.348012 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:51.347989 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-util" (OuterVolumeSpecName: "util") pod "7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" (UID: "7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 19:22:51.443194 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:51.443099 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-bundle\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:51.443194 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:51.443128 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-779n9\" (UniqueName: \"kubernetes.io/projected/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-kube-api-access-779n9\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:51.443194 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:51.443143 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa-util\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:22:52.120367 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:52.120339 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" Jun 14 19:22:52.120367 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:52.120355 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qwmbj" event={"ID":"7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa","Type":"ContainerDied","Data":"26e97759bcce3bbee81da32e30d9603d73eac1e619ba1672a56280b31e7ee850"} Jun 14 19:22:52.120571 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:52.120396 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26e97759bcce3bbee81da32e30d9603d73eac1e619ba1672a56280b31e7ee850" Jun 14 19:22:54.895218 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.895181 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-mtx6d"] Jun 14 19:22:54.895646 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.895552 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" containerName="extract" Jun 14 19:22:54.895646 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.895564 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" containerName="extract" Jun 14 19:22:54.895646 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.895576 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" containerName="util" Jun 14 19:22:54.895646 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.895581 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" containerName="util" Jun 14 19:22:54.895646 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.895595 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" containerName="pull" Jun 14 19:22:54.895646 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.895600 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" containerName="pull" Jun 14 19:22:54.895854 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.895662 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bb81e2d-e767-4c59-84e5-a5ad6fbffdfa" containerName="extract" Jun 14 19:22:54.898832 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.898815 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-mtx6d" Jun 14 19:22:54.901296 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.901276 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 19:22:54.901413 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.901330 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-7xq5k\"" Jun 14 19:22:54.901413 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.901376 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 19:22:54.908351 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.908330 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-mtx6d"] Jun 14 19:22:54.971136 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:54.971108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4n8s\" (UniqueName: \"kubernetes.io/projected/186a943f-10b5-4086-98b3-3d5991d80e2c-kube-api-access-d4n8s\") pod \"keycloak-operator-d67dbbb48-mtx6d\" (UID: \"186a943f-10b5-4086-98b3-3d5991d80e2c\") " pod="keycloak-system/keycloak-operator-d67dbbb48-mtx6d" Jun 14 19:22:55.072346 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:55.072307 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4n8s\" (UniqueName: \"kubernetes.io/projected/186a943f-10b5-4086-98b3-3d5991d80e2c-kube-api-access-d4n8s\") pod \"keycloak-operator-d67dbbb48-mtx6d\" (UID: \"186a943f-10b5-4086-98b3-3d5991d80e2c\") " pod="keycloak-system/keycloak-operator-d67dbbb48-mtx6d" Jun 14 19:22:55.079963 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:55.079940 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4n8s\" (UniqueName: \"kubernetes.io/projected/186a943f-10b5-4086-98b3-3d5991d80e2c-kube-api-access-d4n8s\") pod \"keycloak-operator-d67dbbb48-mtx6d\" (UID: \"186a943f-10b5-4086-98b3-3d5991d80e2c\") " pod="keycloak-system/keycloak-operator-d67dbbb48-mtx6d" Jun 14 19:22:55.210325 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:55.210219 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-mtx6d" Jun 14 19:22:55.344444 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:55.344419 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-mtx6d"] Jun 14 19:22:55.345935 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:22:55.345916 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186a943f_10b5_4086_98b3_3d5991d80e2c.slice/crio-43da693a34e2678f4bee3ee157bdf62a827462d952397901a6798040a63960cc WatchSource:0}: Error finding container 43da693a34e2678f4bee3ee157bdf62a827462d952397901a6798040a63960cc: Status 404 returned error can't find the container with id 43da693a34e2678f4bee3ee157bdf62a827462d952397901a6798040a63960cc Jun 14 19:22:56.150959 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:22:56.150874 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-mtx6d" event={"ID":"186a943f-10b5-4086-98b3-3d5991d80e2c","Type":"ContainerStarted","Data":"43da693a34e2678f4bee3ee157bdf62a827462d952397901a6798040a63960cc"} Jun 14 19:23:01.189682 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:01.189641 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-mtx6d" event={"ID":"186a943f-10b5-4086-98b3-3d5991d80e2c","Type":"ContainerStarted","Data":"054a1a89b426c0f83766d24c16eb1b4b8bdd5a45a4bc2ae0718fa54ed27f7fa7"} Jun 14 19:23:01.205129 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:01.205055 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-mtx6d" podStartSLOduration=1.4591804480000001 podStartE2EDuration="7.205036376s" totalImagesPullingTime="5.745855928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:23:01.203155867 +0000 UTC m=+680.414086825" watchObservedRunningTime="2026-06-14 19:23:01.205036376 +0000 UTC m=+680.415967337" Jun 14 19:23:09.719636 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:09.719603 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:23:09.818725 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:09.818692 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:23:37.374312 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:37.374209 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:23:39.209284 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:39.209247 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:23:39.783305 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:39.783272 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:23:45.314442 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:45.314400 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:23:45.413943 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:45.413909 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:23:45.479840 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:45.479805 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:23:48.950720 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:48.950688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:23:49.049578 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:23:49.049540 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:24:19.277339 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:24:19.277308 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:24:19.628172 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:24:19.628146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:24:19.728920 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:24:19.728890 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:24:19.806713 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:24:19.806683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:25:10.022292 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:25:10.022249 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:25:10.135264 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:25:10.135214 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:25:14.941888 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:25:14.941854 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:25:14.990974 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:25:14.990940 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:25:29.756598 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:25:29.756564 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:25:38.722211 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:25:38.722175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:25:56.954684 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:25:56.954647 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:26:20.463261 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:26:20.463208 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:26:26.349084 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:26:26.349015 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:26:27.357656 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:26:27.357621 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:26:41.280167 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:26:41.280141 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:26:41.281096 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:26:41.281072 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:26:41.284869 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:26:41.284847 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:26:41.285846 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:26:41.285828 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:27:04.454933 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:27:04.454893 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:27:08.147689 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:27:08.147659 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:27:42.632151 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:27:42.632116 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:27:42.730108 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:27:42.730077 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:27:55.548417 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:27:55.548328 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:27:55.597438 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:27:55.597411 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:28:30.859306 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:28:30.859272 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:28:44.469069 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:28:44.469032 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:28:44.517653 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:28:44.517627 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:28:47.770509 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:28:47.770476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:30:00.146203 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:00.146169 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29691090-ddjqn"] Jun 14 19:30:00.149494 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:00.149477 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" Jun 14 19:30:00.151649 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:00.151631 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-r4tmn\"" Jun 14 19:30:00.167681 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:00.167657 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691090-ddjqn"] Jun 14 19:30:00.176972 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:00.176949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkqvs\" (UniqueName: \"kubernetes.io/projected/ac8c81de-e684-4fa7-baa0-2124e0b2893d-kube-api-access-gkqvs\") pod \"maas-api-key-cleanup-29691090-ddjqn\" (UID: \"ac8c81de-e684-4fa7-baa0-2124e0b2893d\") " pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" Jun 14 19:30:00.277615 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:00.277587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkqvs\" (UniqueName: \"kubernetes.io/projected/ac8c81de-e684-4fa7-baa0-2124e0b2893d-kube-api-access-gkqvs\") pod \"maas-api-key-cleanup-29691090-ddjqn\" (UID: \"ac8c81de-e684-4fa7-baa0-2124e0b2893d\") " pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" Jun 14 19:30:00.285967 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:00.285937 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkqvs\" (UniqueName: \"kubernetes.io/projected/ac8c81de-e684-4fa7-baa0-2124e0b2893d-kube-api-access-gkqvs\") pod \"maas-api-key-cleanup-29691090-ddjqn\" (UID: \"ac8c81de-e684-4fa7-baa0-2124e0b2893d\") " pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" Jun 14 19:30:00.459896 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:00.459810 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" Jun 14 19:30:00.588621 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:00.588593 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691090-ddjqn"] Jun 14 19:30:00.589994 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:30:00.589968 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8c81de_e684_4fa7_baa0_2124e0b2893d.slice/crio-96514704be08a1b1e0a99acc81137c39ba801e1a9222736fcf120a77e77fe69a WatchSource:0}: Error finding container 96514704be08a1b1e0a99acc81137c39ba801e1a9222736fcf120a77e77fe69a: Status 404 returned error can't find the container with id 96514704be08a1b1e0a99acc81137c39ba801e1a9222736fcf120a77e77fe69a Jun 14 19:30:00.591863 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:00.591847 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 19:30:01.448432 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:01.448388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" event={"ID":"ac8c81de-e684-4fa7-baa0-2124e0b2893d","Type":"ContainerStarted","Data":"96514704be08a1b1e0a99acc81137c39ba801e1a9222736fcf120a77e77fe69a"} Jun 14 19:30:03.461795 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:03.461759 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" event={"ID":"ac8c81de-e684-4fa7-baa0-2124e0b2893d","Type":"ContainerStarted","Data":"873aa19b3bc6ae14d6fffab8d3269a211f3dda62f565c0b431166f80465d9913"} Jun 14 19:30:03.477851 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:03.477801 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" podStartSLOduration=1.347012914 podStartE2EDuration="3.477786258s" totalImagesPullingTime="2.130773344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:30:03.475400159 +0000 UTC m=+1102.686331116" watchObservedRunningTime="2026-06-14 19:30:03.477786258 +0000 UTC m=+1102.688717216" Jun 14 19:30:04.469101 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:04.469061 2559 generic.go:356] "Generic (PLEG): container finished" podID="ac8c81de-e684-4fa7-baa0-2124e0b2893d" containerID="873aa19b3bc6ae14d6fffab8d3269a211f3dda62f565c0b431166f80465d9913" exitCode=0 Jun 14 19:30:04.469559 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:04.469154 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" event={"ID":"ac8c81de-e684-4fa7-baa0-2124e0b2893d","Type":"ContainerDied","Data":"873aa19b3bc6ae14d6fffab8d3269a211f3dda62f565c0b431166f80465d9913"} Jun 14 19:30:05.608930 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:05.608906 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" Jun 14 19:30:05.728052 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:05.727967 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkqvs\" (UniqueName: \"kubernetes.io/projected/ac8c81de-e684-4fa7-baa0-2124e0b2893d-kube-api-access-gkqvs\") pod \"ac8c81de-e684-4fa7-baa0-2124e0b2893d\" (UID: \"ac8c81de-e684-4fa7-baa0-2124e0b2893d\") " Jun 14 19:30:05.730138 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:05.730106 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8c81de-e684-4fa7-baa0-2124e0b2893d-kube-api-access-gkqvs" (OuterVolumeSpecName: "kube-api-access-gkqvs") pod "ac8c81de-e684-4fa7-baa0-2124e0b2893d" (UID: "ac8c81de-e684-4fa7-baa0-2124e0b2893d"). InnerVolumeSpecName "kube-api-access-gkqvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 19:30:05.829406 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:05.829376 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkqvs\" (UniqueName: \"kubernetes.io/projected/ac8c81de-e684-4fa7-baa0-2124e0b2893d-kube-api-access-gkqvs\") on node \"ip-10-0-133-27.ec2.internal\" DevicePath \"\"" Jun 14 19:30:06.481154 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:06.481123 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" Jun 14 19:30:06.481339 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:06.481156 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691090-ddjqn" event={"ID":"ac8c81de-e684-4fa7-baa0-2124e0b2893d","Type":"ContainerDied","Data":"96514704be08a1b1e0a99acc81137c39ba801e1a9222736fcf120a77e77fe69a"} Jun 14 19:30:06.481339 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:30:06.481203 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96514704be08a1b1e0a99acc81137c39ba801e1a9222736fcf120a77e77fe69a" Jun 14 19:31:41.316449 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:31:41.316415 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:31:41.318109 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:31:41.318086 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:31:41.320814 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:31:41.320793 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:31:41.322488 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:31:41.322470 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4hgz_77965483-dfac-4037-aeac-73b6439d63f4/ovn-acl-logging/0.log" Jun 14 19:32:58.389354 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:32:58.389325 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7d7df895cb-k6bqz_99e77bc4-d320-4b0c-835d-4ebfd59751da/nginx/0.log" Jun 14 19:32:58.620532 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:32:58.620507 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-zgzbc_a435b7ed-4dc4-4390-b684-a3db72d42183/manager/0.log" Jun 14 19:32:58.733595 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:32:58.733527 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-z5j4h_925ea225-be08-4fb8-8999-63c236bd1fd8/manager/0.log" Jun 14 19:32:58.948083 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:32:58.948053 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691090-ddjqn_ac8c81de-e684-4fa7-baa0-2124e0b2893d/cleanup/0.log" Jun 14 19:32:59.172035 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:32:59.172008 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-rd67z_1331503c-8b0c-4b66-acf3-6fa3a4f6cae9/server/0.log" Jun 14 19:32:59.286632 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:32:59.286601 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-2px2r_61906e53-442c-4c8d-a0de-99ad9ed3c34f/manager/0.log" Jun 14 19:32:59.532477 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:32:59.532407 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8bf57587-sf8n9_466c47e2-9f8e-42ff-bd89-759e7bfe83f8/copy-manifests/0.log" Jun 14 19:32:59.538394 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:32:59.538367 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8bf57587-sf8n9_466c47e2-9f8e-42ff-bd89-759e7bfe83f8/manager/0.log" Jun 14 19:32:59.777990 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:32:59.777961 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-g9klx_271a7f07-8fb7-4d38-bfcb-2c8564bc64d5/postgres/0.log" Jun 14 19:33:00.527772 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.527748 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh_0de21275-017b-4967-a554-0588860e764b/util/0.log" Jun 14 19:33:00.533564 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.533547 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh_0de21275-017b-4967-a554-0588860e764b/pull/0.log" Jun 14 19:33:00.539239 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.539212 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh_0de21275-017b-4967-a554-0588860e764b/extract/0.log" Jun 14 19:33:00.647801 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.647771 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn_627fac7f-354e-4874-aa5e-aba8023f0292/util/0.log" Jun 14 19:33:00.653640 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.653622 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn_627fac7f-354e-4874-aa5e-aba8023f0292/pull/0.log" Jun 14 19:33:00.659180 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.659163 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn_627fac7f-354e-4874-aa5e-aba8023f0292/extract/0.log" Jun 14 19:33:00.773784 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.773762 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn_d07a9cc2-4b57-40a3-85a7-745ed242877e/extract/0.log" Jun 14 19:33:00.779291 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.779216 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn_d07a9cc2-4b57-40a3-85a7-745ed242877e/util/0.log" Jun 14 19:33:00.785018 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.785002 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn_d07a9cc2-4b57-40a3-85a7-745ed242877e/pull/0.log" Jun 14 19:33:00.892325 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.892300 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb_457e8ef8-9990-41e3-858d-f0d8702e40d0/util/0.log" Jun 14 19:33:00.897854 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.897837 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb_457e8ef8-9990-41e3-858d-f0d8702e40d0/pull/0.log" Jun 14 19:33:00.902738 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:00.902723 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb_457e8ef8-9990-41e3-858d-f0d8702e40d0/extract/0.log" Jun 14 19:33:01.580007 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:01.579982 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jkg54_1a295ca7-f91a-461d-9e17-2c0bbab1b657/manager/0.log" Jun 14 19:33:02.264188 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:02.264155 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-snsgp_d4205af7-b135-476e-9e37-c692d82e53c2/discovery/0.log" Jun 14 19:33:02.481915 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:02.481888 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-675778c988-zrbq8_6760d320-1c9b-4248-a3b3-560a7f65bb7c/kube-auth-proxy/0.log" Jun 14 19:33:02.931120 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:02.931081 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c6bb87bbb-9vgv7_98c783af-19e4-40a7-921f-d95eec7f1eeb/router/0.log" Jun 14 19:33:08.112647 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.112612 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pqf7v/must-gather-2zqc9"] Jun 14 19:33:08.113072 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.112944 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8c81de-e684-4fa7-baa0-2124e0b2893d" containerName="cleanup" Jun 14 19:33:08.113072 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.112955 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8c81de-e684-4fa7-baa0-2124e0b2893d" containerName="cleanup" Jun 14 19:33:08.113072 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.113027 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac8c81de-e684-4fa7-baa0-2124e0b2893d" containerName="cleanup" Jun 14 19:33:08.116152 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.116132 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pqf7v/must-gather-2zqc9" Jun 14 19:33:08.118295 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.118272 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pqf7v\"/\"default-dockercfg-xdcnz\"" Jun 14 19:33:08.118385 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.118318 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pqf7v\"/\"openshift-service-ca.crt\"" Jun 14 19:33:08.118923 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.118906 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pqf7v\"/\"kube-root-ca.crt\"" Jun 14 19:33:08.131730 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.131704 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pqf7v/must-gather-2zqc9"] Jun 14 19:33:08.136599 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.136572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:33:08.213490 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.213457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkgjs\" (UniqueName: \"kubernetes.io/projected/0352e450-293d-4cc7-88d0-8641a751833e-kube-api-access-dkgjs\") pod \"must-gather-2zqc9\" (UID: \"0352e450-293d-4cc7-88d0-8641a751833e\") " pod="openshift-must-gather-pqf7v/must-gather-2zqc9" Jun 14 19:33:08.213659 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.213509 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0352e450-293d-4cc7-88d0-8641a751833e-must-gather-output\") pod \"must-gather-2zqc9\" (UID: \"0352e450-293d-4cc7-88d0-8641a751833e\") " pod="openshift-must-gather-pqf7v/must-gather-2zqc9" Jun 14 19:33:08.314578 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.314543 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0352e450-293d-4cc7-88d0-8641a751833e-must-gather-output\") pod \"must-gather-2zqc9\" (UID: \"0352e450-293d-4cc7-88d0-8641a751833e\") " pod="openshift-must-gather-pqf7v/must-gather-2zqc9" Jun 14 19:33:08.314808 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.314784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkgjs\" (UniqueName: \"kubernetes.io/projected/0352e450-293d-4cc7-88d0-8641a751833e-kube-api-access-dkgjs\") pod \"must-gather-2zqc9\" (UID: \"0352e450-293d-4cc7-88d0-8641a751833e\") " pod="openshift-must-gather-pqf7v/must-gather-2zqc9" Jun 14 19:33:08.314960 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.314916 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0352e450-293d-4cc7-88d0-8641a751833e-must-gather-output\") pod \"must-gather-2zqc9\" (UID: \"0352e450-293d-4cc7-88d0-8641a751833e\") " pod="openshift-must-gather-pqf7v/must-gather-2zqc9" Jun 14 19:33:08.322296 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.322266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkgjs\" (UniqueName: \"kubernetes.io/projected/0352e450-293d-4cc7-88d0-8641a751833e-kube-api-access-dkgjs\") pod \"must-gather-2zqc9\" (UID: \"0352e450-293d-4cc7-88d0-8641a751833e\") " pod="openshift-must-gather-pqf7v/must-gather-2zqc9" Jun 14 19:33:08.425083 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.425012 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pqf7v/must-gather-2zqc9" Jun 14 19:33:08.555787 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:08.555758 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pqf7v/must-gather-2zqc9"] Jun 14 19:33:08.557248 ip-10-0-133-27 kubenswrapper[2559]: W0614 19:33:08.557206 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0352e450_293d_4cc7_88d0_8641a751833e.slice/crio-f4a604df8e340602f896052ef132c6e501a7c3b42fb50c327e2390f90ddfa093 WatchSource:0}: Error finding container f4a604df8e340602f896052ef132c6e501a7c3b42fb50c327e2390f90ddfa093: Status 404 returned error can't find the container with id f4a604df8e340602f896052ef132c6e501a7c3b42fb50c327e2390f90ddfa093 Jun 14 19:33:09.164737 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:09.164699 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" limit=1024 Jun 14 19:33:09.497611 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:09.496921 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pqf7v/must-gather-2zqc9" event={"ID":"0352e450-293d-4cc7-88d0-8641a751833e","Type":"ContainerStarted","Data":"7d5bd687f4d075df3e2f3cd1136aab4b62790ac1baf6128e4ceda0d6125fccd2"} Jun 14 19:33:09.497611 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:09.496975 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pqf7v/must-gather-2zqc9" event={"ID":"0352e450-293d-4cc7-88d0-8641a751833e","Type":"ContainerStarted","Data":"f8846c41ed767a5f16e7a41637c824c91990c0c80350c3e43da7a38264a28b37"} Jun 14 19:33:09.497611 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:09.496997 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pqf7v/must-gather-2zqc9" event={"ID":"0352e450-293d-4cc7-88d0-8641a751833e","Type":"ContainerStarted","Data":"f4a604df8e340602f896052ef132c6e501a7c3b42fb50c327e2390f90ddfa093"} Jun 14 19:33:09.513498 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:09.513447 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pqf7v/must-gather-2zqc9" podStartSLOduration=0.797396926 podStartE2EDuration="1.51343168s" totalImagesPullingTime="716.034754ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 19:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:33:09.510452774 +0000 UTC m=+1288.721383756" watchObservedRunningTime="2026-06-14 19:33:09.51343168 +0000 UTC m=+1288.724362648" Jun 14 19:33:10.977815 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:10.977778 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v4tdb_6c0903b3-f57f-4cd6-b8eb-ee812d9af73d/global-pull-secret-syncer/0.log" Jun 14 19:33:11.041300 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:11.041267 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2sbm9_1884fa89-bb6f-4754-96a2-272efd304275/konnectivity-agent/0.log" Jun 14 19:33:11.150334 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:11.150308 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-27.ec2.internal_8aebb6dfcd6b7ae7c40cde9de3052ff0/haproxy/0.log" Jun 14 19:33:14.715542 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:14.715508 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-pbz9x_d87fd0d3-bc19-4cc0-a877-876772352bc8/sail-operator/0.log" Jun 14 19:33:15.634656 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.634628 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh_0de21275-017b-4967-a554-0588860e764b/extract/0.log" Jun 14 19:33:15.662093 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.661998 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh_0de21275-017b-4967-a554-0588860e764b/util/0.log" Jun 14 19:33:15.689830 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.689806 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cmvwh_0de21275-017b-4967-a554-0588860e764b/pull/0.log" Jun 14 19:33:15.721423 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.721379 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn_627fac7f-354e-4874-aa5e-aba8023f0292/extract/0.log" Jun 14 19:33:15.748061 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.748035 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn_627fac7f-354e-4874-aa5e-aba8023f0292/util/0.log" Jun 14 19:33:15.773824 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.773779 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2lmn_627fac7f-354e-4874-aa5e-aba8023f0292/pull/0.log" Jun 14 19:33:15.801125 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.801094 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn_d07a9cc2-4b57-40a3-85a7-745ed242877e/extract/0.log" Jun 14 19:33:15.822578 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.822482 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn_d07a9cc2-4b57-40a3-85a7-745ed242877e/util/0.log" Jun 14 19:33:15.844617 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.844549 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gbzdn_d07a9cc2-4b57-40a3-85a7-745ed242877e/pull/0.log" Jun 14 19:33:15.870645 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.870606 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb_457e8ef8-9990-41e3-858d-f0d8702e40d0/extract/0.log" Jun 14 19:33:15.893275 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.893155 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb_457e8ef8-9990-41e3-858d-f0d8702e40d0/util/0.log" Jun 14 19:33:15.915009 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:15.914976 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v7kjb_457e8ef8-9990-41e3-858d-f0d8702e40d0/pull/0.log" Jun 14 19:33:16.108473 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:16.108414 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jkg54_1a295ca7-f91a-461d-9e17-2c0bbab1b657/manager/0.log" Jun 14 19:33:18.222780 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:18.222555 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7vr5_04c1d322-0971-44be-9f06-8c358dfde8de/node-exporter/0.log" Jun 14 19:33:18.244017 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:18.243993 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7vr5_04c1d322-0971-44be-9f06-8c358dfde8de/kube-rbac-proxy/0.log" Jun 14 19:33:18.272291 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:18.272256 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7vr5_04c1d322-0971-44be-9f06-8c358dfde8de/init-textfile/0.log" Jun 14 19:33:18.677138 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:18.677093 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-qq6qj_1fe6b319-afa3-4400-b290-f85609148a54/prometheus-operator/0.log" Jun 14 19:33:18.700640 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:18.700614 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-qq6qj_1fe6b319-afa3-4400-b290-f85609148a54/kube-rbac-proxy/0.log" Jun 14 19:33:18.725065 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:18.725023 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-8n46s_3ee73e71-e8aa-46ae-96fc-d87a768fbe57/prometheus-operator-admission-webhook/0.log" Jun 14 19:33:18.765100 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:18.765070 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b89458f8-hlps6_6c9633f0-c0ff-4d39-9c03-5e15c52169b6/telemeter-client/0.log" Jun 14 19:33:18.786749 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:18.786717 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b89458f8-hlps6_6c9633f0-c0ff-4d39-9c03-5e15c52169b6/reload/0.log" Jun 14 19:33:18.809113 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:18.809082 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b89458f8-hlps6_6c9633f0-c0ff-4d39-9c03-5e15c52169b6/kube-rbac-proxy/0.log" Jun 14 19:33:20.919971 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:20.919944 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/1.log" Jun 14 19:33:20.927842 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:20.927800 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-wqmmr_10e1ea21-cf8b-4548-9b19-0d161456ddbb/console-operator/2.log" Jun 14 19:33:21.848519 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:21.848483 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5"] Jun 14 19:33:21.854496 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:21.854470 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:21.861049 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:21.861016 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5"] Jun 14 19:33:21.954498 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:21.954449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4g48\" (UniqueName: \"kubernetes.io/projected/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-kube-api-access-w4g48\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:21.955105 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:21.955076 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-sys\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:21.955298 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:21.955276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-podres\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:21.955437 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:21.955315 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-proc\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:21.955437 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:21.955343 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-lib-modules\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.056745 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.056711 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4g48\" (UniqueName: \"kubernetes.io/projected/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-kube-api-access-w4g48\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.056920 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.056778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-sys\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.056920 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.056890 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-sys\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.057039 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.056964 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-podres\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.057039 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.057030 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-proc\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.057148 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.057064 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-lib-modules\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.057148 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.057113 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-proc\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.057259 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.057165 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-podres\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.057326 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.057275 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-lib-modules\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.065043 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.064999 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4g48\" (UniqueName: \"kubernetes.io/projected/3079e678-8dfc-4a80-b9d0-e4236ce3ff01-kube-api-access-w4g48\") pod \"perf-node-gather-daemonset-z2bq5\" (UID: \"3079e678-8dfc-4a80-b9d0-e4236ce3ff01\") " pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.168522 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.168437 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.220255 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.216617 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-k7f4j_daab4eab-3bcd-4720-aa03-f0dd757f3df0/volume-data-source-validator/0.log" Jun 14 19:33:22.359054 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.358606 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5"] Jun 14 19:33:22.612304 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.612269 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" event={"ID":"3079e678-8dfc-4a80-b9d0-e4236ce3ff01","Type":"ContainerStarted","Data":"52bd3b0e98110ae06a984039415a04f9a9931ce4942f3adeb88efd6ed95abe54"} Jun 14 19:33:22.612481 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.612333 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" event={"ID":"3079e678-8dfc-4a80-b9d0-e4236ce3ff01","Type":"ContainerStarted","Data":"cc91c78828df16590091366e034959b922c7893ba376b7da7df34e9545bc0063"} Jun 14 19:33:22.612481 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.612364 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:22.629280 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:22.629202 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" podStartSLOduration=1.6291852549999999 podStartE2EDuration="1.629185255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 19:33:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 19:33:22.628115451 +0000 UTC m=+1301.839046422" watchObservedRunningTime="2026-06-14 19:33:22.629185255 +0000 UTC m=+1301.840116211" Jun 14 19:33:23.397643 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:23.397612 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7tp75_be35fe5c-838a-4bd4-b0b5-0c6632fcdb89/dns/0.log" Jun 14 19:33:23.417317 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:23.417292 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7tp75_be35fe5c-838a-4bd4-b0b5-0c6632fcdb89/kube-rbac-proxy/0.log" Jun 14 19:33:23.588052 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:23.588027 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gdfl9_e7e30cee-e377-4a43-8736-212d0069b2b1/dns-node-resolver/0.log" Jun 14 19:33:24.154792 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:24.154764 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqqbl_6267596b-a785-431e-987e-0777491ad548/node-ca/0.log" Jun 14 19:33:25.140345 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:25.140315 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-snsgp_d4205af7-b135-476e-9e37-c692d82e53c2/discovery/0.log" Jun 14 19:33:25.182575 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:25.182539 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-675778c988-zrbq8_6760d320-1c9b-4248-a3b3-560a7f65bb7c/kube-auth-proxy/0.log" Jun 14 19:33:25.281897 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:25.281851 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c6bb87bbb-9vgv7_98c783af-19e4-40a7-921f-d95eec7f1eeb/router/0.log" Jun 14 19:33:25.918791 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:25.918763 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x6zcm_c63db888-e054-4e6a-b1ab-62e6ef8d530a/serve-healthcheck-canary/0.log" Jun 14 19:33:26.566802 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:26.566772 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xntcd_c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb/kube-rbac-proxy/0.log" Jun 14 19:33:26.587385 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:26.587362 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xntcd_c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb/exporter/0.log" Jun 14 19:33:26.608149 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:26.608125 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xntcd_c1a5bf3b-1bcc-4318-b697-dd1f7c2e91eb/extractor/0.log" Jun 14 19:33:28.639587 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:28.639557 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pqf7v/perf-node-gather-daemonset-z2bq5" Jun 14 19:33:28.940275 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:28.940179 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7d7df895cb-k6bqz_99e77bc4-d320-4b0c-835d-4ebfd59751da/nginx/0.log" Jun 14 19:33:28.993416 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:28.993386 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-zgzbc_a435b7ed-4dc4-4390-b684-a3db72d42183/manager/0.log" Jun 14 19:33:29.032450 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:29.032422 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-z5j4h_925ea225-be08-4fb8-8999-63c236bd1fd8/manager/0.log" Jun 14 19:33:29.075431 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:29.075405 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691090-ddjqn_ac8c81de-e684-4fa7-baa0-2124e0b2893d/cleanup/0.log" Jun 14 19:33:29.126632 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:29.126600 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-rd67z_1331503c-8b0c-4b66-acf3-6fa3a4f6cae9/server/0.log" Jun 14 19:33:29.178038 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:29.177998 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-2px2r_61906e53-442c-4c8d-a0de-99ad9ed3c34f/manager/0.log" Jun 14 19:33:29.253628 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:29.253562 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8bf57587-sf8n9_466c47e2-9f8e-42ff-bd89-759e7bfe83f8/manager/0.log" Jun 14 19:33:29.275784 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:29.275758 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8bf57587-sf8n9_466c47e2-9f8e-42ff-bd89-759e7bfe83f8/copy-manifests/0.log" Jun 14 19:33:29.388120 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:29.388086 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-g9klx_271a7f07-8fb7-4d38-bfcb-2c8564bc64d5/postgres/0.log" Jun 14 19:33:31.010140 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:31.010069 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8pcnp_807a089e-5ab6-4cf0-91da-8bdb862228e3/openshift-lws-operator/0.log" Jun 14 19:33:36.013170 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:36.013129 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-snsgp_d4205af7-b135-476e-9e37-c692d82e53c2/discovery/0.log" Jun 14 19:33:36.045073 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:36.045047 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-675778c988-zrbq8_6760d320-1c9b-4248-a3b3-560a7f65bb7c/kube-auth-proxy/0.log" Jun 14 19:33:36.111801 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:36.111751 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c6bb87bbb-9vgv7_98c783af-19e4-40a7-921f-d95eec7f1eeb/router/0.log" Jun 14 19:33:37.223494 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:37.223466 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-snsgp_d4205af7-b135-476e-9e37-c692d82e53c2/discovery/0.log" Jun 14 19:33:37.255125 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:37.255061 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-675778c988-zrbq8_6760d320-1c9b-4248-a3b3-560a7f65bb7c/kube-auth-proxy/0.log" Jun 14 19:33:37.323239 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:37.323178 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c6bb87bbb-9vgv7_98c783af-19e4-40a7-921f-d95eec7f1eeb/router/0.log" Jun 14 19:33:38.233421 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.233392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2bh7_e7af10ad-bbbb-444e-9689-2978956a6e58/kube-multus-additional-cni-plugins/0.log" Jun 14 19:33:38.253732 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.253705 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2bh7_e7af10ad-bbbb-444e-9689-2978956a6e58/egress-router-binary-copy/0.log" Jun 14 19:33:38.275083 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.275055 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2bh7_e7af10ad-bbbb-444e-9689-2978956a6e58/cni-plugins/0.log" Jun 14 19:33:38.293950 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.293926 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2bh7_e7af10ad-bbbb-444e-9689-2978956a6e58/bond-cni-plugin/0.log" Jun 14 19:33:38.313348 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.313322 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2bh7_e7af10ad-bbbb-444e-9689-2978956a6e58/routeoverride-cni/0.log" Jun 14 19:33:38.333205 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.333182 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2bh7_e7af10ad-bbbb-444e-9689-2978956a6e58/whereabouts-cni-bincopy/0.log" Jun 14 19:33:38.354215 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.354189 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2bh7_e7af10ad-bbbb-444e-9689-2978956a6e58/whereabouts-cni/0.log" Jun 14 19:33:38.566160 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.566130 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dndlf_15fe448f-38d6-497c-9685-59d72f86093e/kube-multus/0.log" Jun 14 19:33:38.647265 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.647213 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-64h8v_e2f3c97e-2793-4a18-bc01-3aba6313fd48/network-metrics-daemon/0.log" Jun 14 19:33:38.665944 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.665917 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-64h8v_e2f3c97e-2793-4a18-bc01-3aba6313fd48/kube-rbac-proxy/0.log" Jun 14 19:33:38.951095 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.951064 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-snsgp_d4205af7-b135-476e-9e37-c692d82e53c2/discovery/0.log" Jun 14 19:33:38.978344 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:38.978318 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-675778c988-zrbq8_6760d320-1c9b-4248-a3b3-560a7f65bb7c/kube-auth-proxy/0.log" Jun 14 19:33:39.052210 ip-10-0-133-27 kubenswrapper[2559]: I0614 19:33:39.052180 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c6bb87bbb-9vgv7_98c783af-19e4-40a7-921f-d95eec7f1eeb/router/0.log"