Jun 11 16:44:06.871836 ip-10-0-129-76 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:44:07.340934 ip-10-0-129-76 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:44:07.340934 ip-10-0-129-76 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:44:07.340934 ip-10-0-129-76 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:44:07.340934 ip-10-0-129-76 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:44:07.340934 ip-10-0-129-76 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:44:07.341963 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.341881 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:44:07.346895 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346880 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:07.346895 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346896 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346901 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346905 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346908 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346911 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346913 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346916 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346919 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346921 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346923 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346926 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346929 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346931 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346934 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346937 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346947 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346949 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346952 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346954 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346957 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:07.346957 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346959 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346962 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346965 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346968 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346971 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346974 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346976 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346979 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346981 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346983 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346986 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346988 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346991 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346993 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346996 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.346999 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347002 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347005 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347009 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:07.347481 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347012 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347015 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347017 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347020 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347023 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347025 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347027 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347030 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347032 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347035 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347037 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347039 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347042 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347044 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347046 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347050 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347053 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347055 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347058 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347060 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:07.347941 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347062 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347065 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347067 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347070 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347072 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347074 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347077 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347079 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347083 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347085 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347088 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347093 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347095 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347098 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347100 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347103 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347105 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347108 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347110 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:07.348423 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347112 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347115 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347117 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347119 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347122 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347125 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347128 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347130 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347134 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347137 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347140 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347142 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347145 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347147 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347149 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347152 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347154 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347157 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347159 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347162 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:07.348907 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347848 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347855 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347857 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347860 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347863 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347871 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347875 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347878 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347880 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347883 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347886 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347888 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347891 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347893 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347896 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347898 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347901 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347903 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347906 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347909 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:07.349406 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347912 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347915 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347917 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347919 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347922 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347924 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347927 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347929 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347932 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347935 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347937 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347939 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347944 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347948 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347950 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347953 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347955 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347958 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347961 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347963 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:07.349980 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347966 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347968 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347972 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347976 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347979 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347982 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347985 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347988 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347991 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347994 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.347997 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348000 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348003 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348005 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348008 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348010 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348013 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348015 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348018 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:07.350483 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348020 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348023 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348026 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348028 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348031 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348033 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348036 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348038 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348040 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348043 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348045 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348048 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348051 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348054 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348056 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348059 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348061 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348064 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348066 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348068 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:07.350954 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348071 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348073 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348076 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348079 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348082 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348085 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348088 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348090 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348093 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348095 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348098 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348101 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348103 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348105 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348108 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348112 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348115 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348118 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348122 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:07.351461 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348125 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348516 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348521 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348524 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348526 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348532 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348535 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348539 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348543 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348548 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348552 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348554 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348557 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348560 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348562 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348565 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348567 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348570 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348572 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:07.351914 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348575 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348577 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348580 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348582 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348585 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348587 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348590 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348592 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348595 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348597 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348600 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348602 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348604 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348607 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348610 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348612 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348615 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348617 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348620 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348623 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:07.352409 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348626 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348629 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348633 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348635 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348638 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348640 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348643 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348645 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348647 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348650 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348653 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348655 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348657 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348660 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348663 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348665 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348668 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348670 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348673 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:07.352902 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348675 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348677 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348680 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348682 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348685 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348687 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348690 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348693 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348695 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348698 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348700 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348703 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348705 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348708 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348711 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348715 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348718 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348720 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348723 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348725 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:07.353357 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348727 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348730 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348733 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348735 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348737 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348740 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348742 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348745 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348747 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348750 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348752 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348755 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348758 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348762 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348764 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348767 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348770 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348773 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348776 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:07.353869 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348778 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348781 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.348784 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348883 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348896 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348909 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348915 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348922 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348928 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348935 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348939 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348942 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348945 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348948 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348951 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348954 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348957 2580 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348960 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348963 2580 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348965 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348968 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348973 2580 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348976 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348979 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:44:07.354313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348982 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348985 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348988 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348991 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348994 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.348997 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349001 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349004 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349007 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349010 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349013 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349017 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349020 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349022 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349025 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349028 2580 flags.go:64] FLAG: --enable-server="true" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349031 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349036 2580 flags.go:64] FLAG: --event-burst="100" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349039 2580 flags.go:64] FLAG: --event-qps="50" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349041 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349044 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349047 2580 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349050 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349053 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349056 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:44:07.354951 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349059 2580 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349061 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349064 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349067 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349070 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349073 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349075 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349078 2580 flags.go:64] FLAG: --feature-gates="" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349082 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349084 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349087 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349090 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349093 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349097 2580 flags.go:64] FLAG: --help="false" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349100 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349103 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349106 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349109 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349112 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349115 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349118 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349121 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349123 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:44:07.355569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349127 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349130 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349133 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349136 2580 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349139 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349141 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349144 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349147 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349149 2580 flags.go:64] FLAG: --lock-file="" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349152 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349155 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349157 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349162 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349165 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349168 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349170 2580 flags.go:64] FLAG: --logging-format="text" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349173 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349176 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349179 2580 flags.go:64] FLAG: --manifest-url="" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349181 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349185 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349188 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349194 2580 flags.go:64] FLAG: --max-pods="110" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349196 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349199 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:44:07.356145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349202 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349205 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349207 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349210 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349213 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349220 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349222 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349225 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349228 2580 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349231 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349236 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349239 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349241 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349244 2580 flags.go:64] FLAG: --port="10250" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349247 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349250 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e0f2d8d4bf132b67" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349253 2580 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349256 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349259 2580 flags.go:64] FLAG: --register-node="true" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349261 2580 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349264 2580 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349267 2580 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349270 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349272 2580 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349276 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:44:07.357028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349278 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349281 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349284 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349286 2580 flags.go:64] FLAG: --runonce="false" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349290 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349293 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349296 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349298 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349301 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349303 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349306 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349309 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349312 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349315 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349317 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349322 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349325 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349328 2580 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349331 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349336 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349339 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349341 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349345 2580 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349348 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349351 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:44:07.358114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349354 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349356 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349359 2580 flags.go:64] FLAG: --v="2" Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349363 2580 flags.go:64] FLAG: --version="false" Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349366 2580 flags.go:64] FLAG: --vmodule="" Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349370 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.349373 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349524 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349529 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349532 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349535 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349539 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349542 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349544 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349547 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349549 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349552 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349554 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349558 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349560 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349562 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:07.359019 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349565 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349569 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349571 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349574 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349577 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349579 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349582 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349586 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349589 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349593 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349596 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349599 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349601 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349604 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349607 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349610 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349612 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349615 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349617 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:07.359596 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349619 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349622 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349624 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349628 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349630 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349633 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349635 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349638 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349640 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349643 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349645 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349648 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349650 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349652 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349657 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349659 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349662 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349664 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349667 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349670 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:07.360365 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349674 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349677 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349680 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349683 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349685 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349688 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349690 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349693 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349695 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349698 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349700 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349703 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349705 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349707 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349710 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349714 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349716 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349719 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349721 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349724 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:07.361207 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349726 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349729 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349731 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349734 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349736 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349739 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349742 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349745 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349747 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349749 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349752 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349755 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349758 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349761 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349764 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349767 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349769 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349772 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349774 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:07.361763 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349777 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349779 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349782 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349784 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349787 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349789 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.349792 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.350678 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.358635 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.358782 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.359709 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.359724 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359811 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359819 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359824 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:07.362518 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359829 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359834 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359838 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359844 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359850 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359856 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359861 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359865 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359870 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359875 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359879 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359884 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359888 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359893 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359897 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359901 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359905 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359910 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359916 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:07.362896 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359922 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359927 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359931 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359935 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359939 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359943 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359947 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359953 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359957 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359961 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359966 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359969 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359974 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359978 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359982 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359986 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359990 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359994 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.359998 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360003 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:07.363350 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360007 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360011 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360014 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360018 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360023 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360027 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360032 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360036 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360039 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360044 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360048 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360052 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360056 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360059 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360063 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360068 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360072 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360076 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360080 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360085 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:07.363878 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360090 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360094 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360098 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360102 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360106 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360110 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360115 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360119 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360123 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360127 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360131 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360135 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360139 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360143 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360147 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360151 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360155 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360159 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360163 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360167 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:07.364395 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360171 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360175 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360179 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360186 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360191 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360195 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360200 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360205 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360209 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360213 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360217 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360222 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360226 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360239 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360244 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360248 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:07.364887 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360253 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.360261 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360433 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360442 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360465 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360470 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360475 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360479 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360483 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360487 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360492 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360496 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360500 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360503 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360507 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:07.365271 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360512 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360517 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360521 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360525 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360529 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360533 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360538 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360545 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360551 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360556 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360561 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360566 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360570 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360575 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360579 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360585 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360590 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360594 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360598 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:07.365875 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360603 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360606 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360611 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360615 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360621 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360626 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360632 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360639 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360644 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360648 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360652 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360656 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360660 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360665 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360669 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360673 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360677 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360681 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360685 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:07.366679 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360690 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360694 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360699 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360703 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360708 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360712 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360716 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360721 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360725 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360729 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360734 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360738 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360742 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360746 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360750 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360755 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360759 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360763 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360767 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360771 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:07.367277 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360775 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360779 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360783 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360787 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360791 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360795 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360799 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360804 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360808 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360813 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360817 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360821 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360825 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360829 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360833 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360837 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360842 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360846 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360850 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360854 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:07.367786 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360858 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:07.368299 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360862 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:07.368299 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360865 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:07.368299 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360870 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:07.368299 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360875 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:07.368299 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360879 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:07.368299 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360883 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:07.368299 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:07.360887 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:07.368299 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.360895 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:44:07.368299 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.361039 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:44:07.368299 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.367034 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:44:07.368822 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.368808 2580 server.go:1019] "Starting client certificate rotation" Jun 11 16:44:07.368924 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.368908 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:44:07.368961 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.368950 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:44:07.372820 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.372802 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:44:07.376818 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.376794 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:44:07.393461 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.393434 2580 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:44:07.397307 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.397293 2580 log.go:25] "Validated CRI v1 image API" Jun 11 16:44:07.398113 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.398095 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:44:07.400713 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.400692 2580 fs.go:135] Filesystem UUIDs: map[52c640d7-f47e-4a36-aeec-916cd6c04b12:/dev/nvme0n1p4 6ff78e9d-43c1-4068-a232-4722964c0648:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 11 16:44:07.400796 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.400711 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:44:07.402328 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.402302 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:44:07.405110 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.404998 2580 manager.go:216] Machine: {Timestamp:2026-06-11 16:44:07.404516851 +0000 UTC m=+0.382992372 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3128062 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cbec3f3e3ed6262416fe15172002e SystemUUID:ec2cbec3-f3e3-ed62-6241-6fe15172002e BootID:fbe309df-1230-470f-a9e7-94f815d68e48 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9a:a6:24:c0:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9a:a6:24:c0:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:72:97:cd:52:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:44:07.405110 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.405097 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:44:07.405254 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.405186 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:44:07.408584 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.408557 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:44:07.408718 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.408587 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-76.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:44:07.409475 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.409465 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:44:07.409510 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.409477 2580 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:44:07.409510 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.409484 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:44:07.409510 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.409498 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:44:07.410778 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.410768 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:44:07.415102 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.415090 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:44:07.415240 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.415230 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:44:07.415273 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.415263 2580 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:44:07.415312 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.415276 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:44:07.415312 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.415300 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:44:07.415375 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.415314 2580 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:44:07.415375 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.415325 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:44:07.415950 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.415937 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:44:07.415996 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.415957 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:44:07.419115 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.419095 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:44:07.421522 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.421507 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:44:07.421598 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.421538 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:44:07.422996 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.422985 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:44:07.423031 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423001 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:44:07.423031 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423007 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:44:07.423031 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423012 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:44:07.423031 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423021 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:44:07.423031 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423026 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:44:07.423031 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423034 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:44:07.423236 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423039 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:44:07.423236 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423046 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:44:07.423236 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423051 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:44:07.423236 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423059 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:44:07.423236 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423064 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:44:07.423940 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423924 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:44:07.423940 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.423936 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:44:07.424512 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.424497 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vmzzr" Jun 11 16:44:07.425484 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.425469 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-76.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:44:07.425753 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.425731 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-76.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:44:07.425817 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.425771 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:44:07.427025 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.427012 2580 server.go:1268] "Started kubelet" Jun 11 16:44:07.427139 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.427114 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:44:07.431435 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.427131 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:44:07.431435 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.431074 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:44:07.431620 ip-10-0-129-76 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:44:07.432298 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.432152 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vmzzr" Jun 11 16:44:07.433727 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.433588 2580 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:44:07.435662 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.435640 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:44:07.440651 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.440627 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:44:07.442051 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.442031 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:44:07.442143 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.442116 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:07.442208 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.442034 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:44:07.442802 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.442784 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:44:07.442939 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.442919 2580 factory.go:55] Registering systemd factory Jun 11 16:44:07.442939 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.442942 2580 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:44:07.443068 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.442991 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:44:07.443068 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.443038 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:44:07.443162 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.443114 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:44:07.443162 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.443122 2580 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:44:07.443250 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.443176 2580 factory.go:153] Registering CRI-O factory Jun 11 16:44:07.443250 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.443188 2580 factory.go:223] Registration of the crio container factory successfully Jun 11 16:44:07.443250 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.443239 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:44:07.443380 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.443258 2580 factory.go:103] Registering Raw factory Jun 11 16:44:07.443380 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.443268 2580 manager.go:1196] Started watching for new ooms in manager Jun 11 16:44:07.443668 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.443658 2580 manager.go:349] Starting recovery of all containers Jun 11 16:44:07.447272 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.447250 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:07.449616 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.449591 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-76.ec2.internal\" not found" node="ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.450672 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.450658 2580 manager.go:354] Recovery completed Jun 11 16:44:07.455594 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.455580 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:07.457705 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.457690 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:07.457764 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.457719 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:07.457764 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.457733 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:07.458225 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.458213 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:44:07.458275 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.458227 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:07.458275 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.458226 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:44:07.458275 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.458252 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:44:07.459365 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.459349 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:07.459424 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.459377 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:07.459424 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.459390 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:07.460158 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.460146 2580 policy_none.go:49] "None policy: Start" Jun 11 16:44:07.460194 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.460163 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:44:07.460194 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.460174 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:44:07.461861 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.461849 2580 policy_none.go:47] "Start" Jun 11 16:44:07.498015 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.498001 2580 manager.go:337] "Starting Device Plugin manager" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.498061 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.498075 2580 server.go:87] "Starting device plugin registration server" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.498303 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.498314 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.498387 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.498480 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.498490 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.499179 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.499225 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.513952 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.515232 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.515275 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.515296 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.515346 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:44:07.522937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.517608 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:07.598637 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.598586 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:07.599615 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.599597 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:07.599731 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.599631 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:07.599731 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.599644 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:07.599731 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.599676 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.608803 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.608785 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.608896 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.608806 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-76.ec2.internal\": node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:07.616077 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.616049 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-76.ec2.internal"] Jun 11 16:44:07.616147 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.616112 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:07.616838 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.616824 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:07.616898 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.616852 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:07.616898 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.616866 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:07.619320 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.619308 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:07.619414 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.619402 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.619465 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.619432 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:07.619967 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.619941 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:07.619967 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.619949 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:07.620077 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.620000 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:07.620077 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.620015 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:07.620077 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.619969 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:07.620077 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.620037 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:07.621497 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.621479 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:07.622219 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.622202 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.622280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.622227 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:07.622956 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.622939 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:07.623016 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.622971 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:07.623016 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.622985 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:07.646015 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.645990 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-76.ec2.internal\" not found" node="ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.650170 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.650152 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-76.ec2.internal\" not found" node="ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.721964 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.721940 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:07.744541 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.744517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/237712fb2fccf60cb12027310385dc0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal\" (UID: \"237712fb2fccf60cb12027310385dc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.744607 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.744545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/237712fb2fccf60cb12027310385dc0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal\" (UID: \"237712fb2fccf60cb12027310385dc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.744607 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.744560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6a27aac0db19b06d35dee5533ce37c71-config\") pod \"kube-apiserver-proxy-ip-10-0-129-76.ec2.internal\" (UID: \"6a27aac0db19b06d35dee5533ce37c71\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.822164 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.822135 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:07.845540 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.845514 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/237712fb2fccf60cb12027310385dc0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal\" (UID: \"237712fb2fccf60cb12027310385dc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.845619 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.845474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/237712fb2fccf60cb12027310385dc0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal\" (UID: \"237712fb2fccf60cb12027310385dc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.845619 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.845586 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/237712fb2fccf60cb12027310385dc0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal\" (UID: \"237712fb2fccf60cb12027310385dc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.845619 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.845605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6a27aac0db19b06d35dee5533ce37c71-config\") pod \"kube-apiserver-proxy-ip-10-0-129-76.ec2.internal\" (UID: \"6a27aac0db19b06d35dee5533ce37c71\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.845740 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.845640 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6a27aac0db19b06d35dee5533ce37c71-config\") pod \"kube-apiserver-proxy-ip-10-0-129-76.ec2.internal\" (UID: \"6a27aac0db19b06d35dee5533ce37c71\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.845740 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.845677 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/237712fb2fccf60cb12027310385dc0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal\" (UID: \"237712fb2fccf60cb12027310385dc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.922905 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:07.922844 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:07.952280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.952258 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" Jun 11 16:44:07.957690 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:07.957199 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-76.ec2.internal" Jun 11 16:44:08.023522 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:08.023484 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:08.124045 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:08.124021 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:08.224557 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:08.224494 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:08.325169 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:08.325139 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:08.367595 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.367572 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:44:08.368223 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.367702 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:44:08.368223 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.367750 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:44:08.426129 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:08.426103 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:08.441522 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.441490 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:39:07 +0000 UTC" deadline="2028-01-17 00:22:18.69987073 +0000 UTC" Jun 11 16:44:08.441522 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.441520 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14023h38m10.258354541s" Jun 11 16:44:08.527229 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:08.527207 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:08.529320 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.529283 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:08.529466 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:08.529412 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a27aac0db19b06d35dee5533ce37c71.slice/crio-185eaba7ae3db3b82ef725689ac5bcaa8805f8aaf08c06a51b499e2a59cfd35e WatchSource:0}: Error finding container 185eaba7ae3db3b82ef725689ac5bcaa8805f8aaf08c06a51b499e2a59cfd35e: Status 404 returned error can't find the container with id 185eaba7ae3db3b82ef725689ac5bcaa8805f8aaf08c06a51b499e2a59cfd35e Jun 11 16:44:08.529775 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:08.529754 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237712fb2fccf60cb12027310385dc0d.slice/crio-485b16b69df68c25016ec35cbbae3c68e372ef0c8554f91f851a33bb79160f8e WatchSource:0}: Error finding container 485b16b69df68c25016ec35cbbae3c68e372ef0c8554f91f851a33bb79160f8e: Status 404 returned error can't find the container with id 485b16b69df68c25016ec35cbbae3c68e372ef0c8554f91f851a33bb79160f8e Jun 11 16:44:08.533987 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.533970 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:44:08.628022 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:08.627984 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:08.728491 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:08.728444 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-76.ec2.internal\" not found" Jun 11 16:44:08.825280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.825220 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:08.842935 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.842911 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" Jun 11 16:44:08.853607 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.853589 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:44:08.854793 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.854779 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-76.ec2.internal" Jun 11 16:44:08.862758 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:08.862738 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:44:09.323120 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.323033 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:09.416845 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.416818 2580 apiserver.go:52] "Watching apiserver" Jun 11 16:44:09.426425 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.426403 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:44:09.426780 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.426756 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-lnwpx","openshift-image-registry/node-ca-n45kd","openshift-multus/multus-additional-cni-plugins-pw9xx","openshift-multus/multus-p98c6","openshift-multus/network-metrics-daemon-f226j","openshift-network-operator/iptables-alerter-452ql","kube-system/global-pull-secret-syncer-k79r4","kube-system/kube-apiserver-proxy-ip-10-0-129-76.ec2.internal","openshift-dns/node-resolver-tzg8h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal","openshift-network-diagnostics/network-check-target-qgck5","openshift-ovn-kubernetes/ovnkube-node-cd85h","kube-system/konnectivity-agent-x5zjm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc"] Jun 11 16:44:09.429433 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.429409 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:09.429563 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:09.429524 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:09.431427 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.431408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:09.433416 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.433396 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.433729 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.433679 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xm2g9\"" Jun 11 16:44:09.433898 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.433780 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:44:09.433898 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.433854 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:44:09.435464 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.435435 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:44:09.435958 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.435637 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:44:09.435958 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.435715 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:44:09.435958 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.435838 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:44:09.435958 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.435866 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:44:09.435958 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.435946 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9f2wc\"" Jun 11 16:44:09.436204 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.436009 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.437680 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.437662 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:09.437771 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:09.437744 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:09.438005 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.437985 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lqxbq\"" Jun 11 16:44:09.438098 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.437997 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:44:09.440659 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.440631 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:09.440854 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.440837 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-452ql" Jun 11 16:44:09.442629 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.442608 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:44:09.442723 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.442702 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:44:09.442907 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.442890 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tzg8h" Jun 11 16:44:09.443536 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.443506 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:44:09.443745 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.443727 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:44:09.444323 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.444294 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xvcpc\"" Jun 11 16:44:09.444854 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.444837 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zgcff\"" Jun 11 16:44:09.444943 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.444870 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:44:09.445275 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.445256 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.445861 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.445732 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:44:09.447127 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.447109 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:44:09.447363 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.447345 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fv426\"" Jun 11 16:44:09.447645 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.447629 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:44:09.448503 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.448482 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n45kd" Jun 11 16:44:09.450804 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.450774 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:44:09.450901 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.450808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.450901 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.450822 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:44:09.451647 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.451630 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:44:09.451911 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.450783 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p9dhk\"" Jun 11 16:44:09.453559 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.453540 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:44:09.453809 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.453786 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:44:09.453950 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.453912 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:44:09.454016 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.453991 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:44:09.454247 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76b1dbe2-fe88-439f-9364-2b6d510dd976-agent-certs\") pod \"konnectivity-agent-x5zjm\" (UID: \"76b1dbe2-fe88-439f-9364-2b6d510dd976\") " pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:09.454335 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454255 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-system-cni-dir\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.454335 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-var-lib-cni-bin\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.454335 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454316 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:09.454511 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454339 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-28fk9\"" Jun 11 16:44:09.454511 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454347 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfstv\" (UniqueName: \"kubernetes.io/projected/964a13c0-b018-4d56-8c4a-850c6331d408-kube-api-access-dfstv\") pod \"iptables-alerter-452ql\" (UID: \"964a13c0-b018-4d56-8c4a-850c6331d408\") " pod="openshift-network-operator/iptables-alerter-452ql" Jun 11 16:44:09.454511 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-sys\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.454511 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454405 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-tuned\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.454511 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/822c473e-85e5-4340-8473-ad3f7f993dda-kubelet-config\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:09.454511 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454476 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-multus-cni-dir\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.454511 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-hostroot\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.454808 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454543 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/090876e6-05f9-4e60-9e0c-a5dddc8571af-hosts-file\") pod \"node-resolver-tzg8h\" (UID: \"090876e6-05f9-4e60-9e0c-a5dddc8571af\") " pod="openshift-dns/node-resolver-tzg8h" Jun 11 16:44:09.454808 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-cnibin\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.454808 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454637 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-os-release\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.454808 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/964a13c0-b018-4d56-8c4a-850c6331d408-host-slash\") pod \"iptables-alerter-452ql\" (UID: \"964a13c0-b018-4d56-8c4a-850c6331d408\") " pod="openshift-network-operator/iptables-alerter-452ql" Jun 11 16:44:09.454808 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-run\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.454808 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-var-lib-cni-multus\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.454808 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-var-lib-kubelet\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.455100 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-multus-conf-dir\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.455100 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454861 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1446fd9f-01f4-414c-9874-049aef85e422-multus-daemon-config\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.455100 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454942 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-run-multus-certs\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.455100 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.454981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.455100 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-systemd\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.455100 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/822c473e-85e5-4340-8473-ad3f7f993dda-dbus\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:09.455100 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:09.455100 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455079 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-cnibin\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.455398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455132 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-os-release\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.455398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455164 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-multus-socket-dir-parent\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.455398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455189 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vllw9\" (UniqueName: \"kubernetes.io/projected/090876e6-05f9-4e60-9e0c-a5dddc8571af-kube-api-access-vllw9\") pod \"node-resolver-tzg8h\" (UID: \"090876e6-05f9-4e60-9e0c-a5dddc8571af\") " pod="openshift-dns/node-resolver-tzg8h" Jun 11 16:44:09.455398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67nn5\" (UniqueName: \"kubernetes.io/projected/0682191c-9cec-4f46-a400-6053e8f3e033-kube-api-access-67nn5\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:09.455398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-kubernetes\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.455398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455293 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpxdx\" (UniqueName: \"kubernetes.io/projected/1446fd9f-01f4-414c-9874-049aef85e422-kube-api-access-wpxdx\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.455398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/090876e6-05f9-4e60-9e0c-a5dddc8571af-tmp-dir\") pod \"node-resolver-tzg8h\" (UID: \"090876e6-05f9-4e60-9e0c-a5dddc8571af\") " pod="openshift-dns/node-resolver-tzg8h" Jun 11 16:44:09.455398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455363 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.455398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-host\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.455896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed3d3e6f-2e2c-4115-810e-f0033869c342-tmp\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.455896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-run-k8s-cni-cncf-io\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.455896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455525 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-run-netns\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.455896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-system-cni-dir\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.455896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455671 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-etc-kubernetes\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.455896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.455896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455743 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.455896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcnzh\" (UniqueName: \"kubernetes.io/projected/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-kube-api-access-lcnzh\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.455896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-modprobe-d\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.455896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455847 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:09.455896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.455872 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-lib-modules\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.456384 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.456296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-var-lib-kubelet\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.456384 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.456336 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76b1dbe2-fe88-439f-9364-2b6d510dd976-konnectivity-ca\") pod \"konnectivity-agent-x5zjm\" (UID: \"76b1dbe2-fe88-439f-9364-2b6d510dd976\") " pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:09.456384 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.456372 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1446fd9f-01f4-414c-9874-049aef85e422-cni-binary-copy\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.456642 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:09.456376 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:09.456642 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.456403 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/964a13c0-b018-4d56-8c4a-850c6331d408-iptables-alerter-script\") pod \"iptables-alerter-452ql\" (UID: \"964a13c0-b018-4d56-8c4a-850c6331d408\") " pod="openshift-network-operator/iptables-alerter-452ql" Jun 11 16:44:09.456642 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.456422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-sysconfig\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.456642 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.456461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-sysctl-d\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.456642 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.456493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-sysctl-conf\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.456642 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.456520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzvvj\" (UniqueName: \"kubernetes.io/projected/ed3d3e6f-2e2c-4115-810e-f0033869c342-kube-api-access-pzvvj\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.458646 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.458624 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.461226 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.461196 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:44:09.461322 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.461303 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:44:09.462280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.462263 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:44:09.462479 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.462275 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:44:09.462575 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.462306 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6v5gc\"" Jun 11 16:44:09.462575 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.462339 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:44:09.462575 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.462375 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:44:09.476972 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.476951 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9v4rn" Jun 11 16:44:09.485867 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.485846 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9v4rn" Jun 11 16:44:09.519979 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.519933 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" event={"ID":"237712fb2fccf60cb12027310385dc0d","Type":"ContainerStarted","Data":"485b16b69df68c25016ec35cbbae3c68e372ef0c8554f91f851a33bb79160f8e"} Jun 11 16:44:09.521116 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.521091 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-76.ec2.internal" event={"ID":"6a27aac0db19b06d35dee5533ce37c71","Type":"ContainerStarted","Data":"185eaba7ae3db3b82ef725689ac5bcaa8805f8aaf08c06a51b499e2a59cfd35e"} Jun 11 16:44:09.544210 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.544180 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:44:09.557227 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557198 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67nn5\" (UniqueName: \"kubernetes.io/projected/0682191c-9cec-4f46-a400-6053e8f3e033-kube-api-access-67nn5\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:09.557342 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-kubernetes\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.557342 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557256 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed3d3e6f-2e2c-4115-810e-f0033869c342-tmp\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.557342 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557330 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-kubernetes\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.557513 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.557513 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557405 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-cni-bin\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.557513 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.557513 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-run-k8s-cni-cncf-io\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557543 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-run-netns\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-system-cni-dir\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557579 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557616 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-system-cni-dir\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557649 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-socket-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557654 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-run-netns\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-kubelet\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557688 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-run-k8s-cni-cncf-io\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557704 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-var-lib-openvswitch\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cm4b\" (UniqueName: \"kubernetes.io/projected/fb9c02ea-368b-4b3b-8de1-6930d11884c3-kube-api-access-5cm4b\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.557770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-etc-kubernetes\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557809 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-etc-kubernetes\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnzh\" (UniqueName: \"kubernetes.io/projected/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-kube-api-access-lcnzh\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-lib-modules\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557891 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1446fd9f-01f4-414c-9874-049aef85e422-cni-binary-copy\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557913 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/964a13c0-b018-4d56-8c4a-850c6331d408-iptables-alerter-script\") pod \"iptables-alerter-452ql\" (UID: \"964a13c0-b018-4d56-8c4a-850c6331d408\") " pod="openshift-network-operator/iptables-alerter-452ql" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557937 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-sysctl-d\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-sysctl-conf\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557977 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzvvj\" (UniqueName: \"kubernetes.io/projected/ed3d3e6f-2e2c-4115-810e-f0033869c342-kube-api-access-pzvvj\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557992 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-lib-modules\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-run-netns\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558045 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76b1dbe2-fe88-439f-9364-2b6d510dd976-agent-certs\") pod \"konnectivity-agent-x5zjm\" (UID: \"76b1dbe2-fe88-439f-9364-2b6d510dd976\") " pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-system-cni-dir\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558093 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.558187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558116 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-sysctl-conf\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558228 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-sysctl-d\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-sys\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558496 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-tuned\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558209 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-system-cni-dir\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558416 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/964a13c0-b018-4d56-8c4a-850c6331d408-iptables-alerter-script\") pod \"iptables-alerter-452ql\" (UID: \"964a13c0-b018-4d56-8c4a-850c6331d408\") " pod="openshift-network-operator/iptables-alerter-452ql" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.557956 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558528 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-sys\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlsbf\" (UniqueName: \"kubernetes.io/projected/71f1974b-b0b3-4e95-a28f-ecf316d56002-kube-api-access-mlsbf\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k9ss\" (UniqueName: \"kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss\") pod \"network-check-target-qgck5\" (UID: \"e318d141-fc7e-4509-9151-d606a86bb95d\") " pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-systemd-units\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558607 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-etc-openvswitch\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558608 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1446fd9f-01f4-414c-9874-049aef85e422-cni-binary-copy\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/822c473e-85e5-4340-8473-ad3f7f993dda-kubelet-config\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-hostroot\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/090876e6-05f9-4e60-9e0c-a5dddc8571af-hosts-file\") pod \"node-resolver-tzg8h\" (UID: \"090876e6-05f9-4e60-9e0c-a5dddc8571af\") " pod="openshift-dns/node-resolver-tzg8h" Jun 11 16:44:09.558742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-cnibin\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/964a13c0-b018-4d56-8c4a-850c6331d408-host-slash\") pod \"iptables-alerter-452ql\" (UID: \"964a13c0-b018-4d56-8c4a-850c6331d408\") " pod="openshift-network-operator/iptables-alerter-452ql" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558756 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/822c473e-85e5-4340-8473-ad3f7f993dda-kubelet-config\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558760 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/090876e6-05f9-4e60-9e0c-a5dddc8571af-hosts-file\") pod \"node-resolver-tzg8h\" (UID: \"090876e6-05f9-4e60-9e0c-a5dddc8571af\") " pod="openshift-dns/node-resolver-tzg8h" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-run\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558776 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-hostroot\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-host\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558810 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/964a13c0-b018-4d56-8c4a-850c6331d408-host-slash\") pod \"iptables-alerter-452ql\" (UID: \"964a13c0-b018-4d56-8c4a-850c6331d408\") " pod="openshift-network-operator/iptables-alerter-452ql" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558823 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-run\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-run-ovn\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558847 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-host\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-run-multus-certs\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558915 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-run-multus-certs\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558919 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b95027c8-1005-4bdf-b0cf-c095e8d14eb9-host\") pod \"node-ca-n45kd\" (UID: \"b95027c8-1005-4bdf-b0cf-c095e8d14eb9\") " pod="openshift-image-registry/node-ca-n45kd" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558961 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-sys-fs\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558985 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.559518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb9c02ea-368b-4b3b-8de1-6930d11884c3-ovnkube-script-lib\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-os-release\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-multus-socket-dir-parent\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vllw9\" (UniqueName: \"kubernetes.io/projected/090876e6-05f9-4e60-9e0c-a5dddc8571af-kube-api-access-vllw9\") pod \"node-resolver-tzg8h\" (UID: \"090876e6-05f9-4e60-9e0c-a5dddc8571af\") " pod="openshift-dns/node-resolver-tzg8h" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559121 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559124 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-os-release\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559157 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-run-systemd\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-cni-netd\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559189 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-multus-socket-dir-parent\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559201 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpxdx\" (UniqueName: \"kubernetes.io/projected/1446fd9f-01f4-414c-9874-049aef85e422-kube-api-access-wpxdx\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.558802 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-cnibin\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/090876e6-05f9-4e60-9e0c-a5dddc8571af-tmp-dir\") pod \"node-resolver-tzg8h\" (UID: \"090876e6-05f9-4e60-9e0c-a5dddc8571af\") " pod="openshift-dns/node-resolver-tzg8h" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-slash\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559311 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-log-socket\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559327 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-node-log\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559338 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.560579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559362 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-modprobe-d\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-var-lib-kubelet\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559440 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-modprobe-d\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559499 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-registration-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559503 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/090876e6-05f9-4e60-9e0c-a5dddc8571af-tmp-dir\") pod \"node-resolver-tzg8h\" (UID: \"090876e6-05f9-4e60-9e0c-a5dddc8571af\") " pod="openshift-dns/node-resolver-tzg8h" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76b1dbe2-fe88-439f-9364-2b6d510dd976-konnectivity-ca\") pod \"konnectivity-agent-x5zjm\" (UID: \"76b1dbe2-fe88-439f-9364-2b6d510dd976\") " pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559551 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-sysconfig\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559591 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b95027c8-1005-4bdf-b0cf-c095e8d14eb9-serviceca\") pod \"node-ca-n45kd\" (UID: \"b95027c8-1005-4bdf-b0cf-c095e8d14eb9\") " pod="openshift-image-registry/node-ca-n45kd" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559597 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-var-lib-kubelet\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559620 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8wm9\" (UniqueName: \"kubernetes.io/projected/b95027c8-1005-4bdf-b0cf-c095e8d14eb9-kube-api-access-w8wm9\") pod \"node-ca-n45kd\" (UID: \"b95027c8-1005-4bdf-b0cf-c095e8d14eb9\") " pod="openshift-image-registry/node-ca-n45kd" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559643 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-sysconfig\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb9c02ea-368b-4b3b-8de1-6930d11884c3-ovn-node-metrics-cert\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-var-lib-cni-bin\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfstv\" (UniqueName: \"kubernetes.io/projected/964a13c0-b018-4d56-8c4a-850c6331d408-kube-api-access-dfstv\") pod \"iptables-alerter-452ql\" (UID: \"964a13c0-b018-4d56-8c4a-850c6331d408\") " pod="openshift-network-operator/iptables-alerter-452ql" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559814 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-run-openvswitch\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559838 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb9c02ea-368b-4b3b-8de1-6930d11884c3-ovnkube-config\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.561421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-multus-cni-dir\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559897 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-os-release\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559925 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-var-lib-cni-multus\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559942 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-multus-cni-dir\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-var-lib-kubelet\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559977 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-var-lib-cni-bin\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.559994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-multus-conf-dir\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1446fd9f-01f4-414c-9874-049aef85e422-multus-daemon-config\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:09.560054 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560067 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-systemd\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560089 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560093 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-device-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:09.560133 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs podName:0682191c-9cec-4f46-a400-6053e8f3e033 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:10.060094361 +0000 UTC m=+3.038569886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs") pod "network-metrics-daemon-f226j" (UID: "0682191c-9cec-4f46-a400-6053e8f3e033") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560138 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-multus-conf-dir\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560156 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76b1dbe2-fe88-439f-9364-2b6d510dd976-konnectivity-ca\") pod \"konnectivity-agent-x5zjm\" (UID: \"76b1dbe2-fe88-439f-9364-2b6d510dd976\") " pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb9c02ea-368b-4b3b-8de1-6930d11884c3-env-overrides\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/822c473e-85e5-4340-8473-ad3f7f993dda-dbus\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:09.562121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-cnibin\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560294 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-os-release\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560415 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-cnibin\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560414 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/822c473e-85e5-4340-8473-ad3f7f993dda-dbus\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:09.560439 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560480 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-var-lib-kubelet\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:09.560506 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret podName:822c473e-85e5-4340-8473-ad3f7f993dda nodeName:}" failed. No retries permitted until 2026-06-11 16:44:10.060492142 +0000 UTC m=+3.038967667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret") pod "global-pull-secret-syncer-k79r4" (UID: "822c473e-85e5-4340-8473-ad3f7f993dda") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560507 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-systemd\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560549 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1446fd9f-01f4-414c-9874-049aef85e422-host-var-lib-cni-multus\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.560731 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1446fd9f-01f4-414c-9874-049aef85e422-multus-daemon-config\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.561073 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed3d3e6f-2e2c-4115-810e-f0033869c342-tmp\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.561915 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76b1dbe2-fe88-439f-9364-2b6d510dd976-agent-certs\") pod \"konnectivity-agent-x5zjm\" (UID: \"76b1dbe2-fe88-439f-9364-2b6d510dd976\") " pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:09.562732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.561923 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed3d3e6f-2e2c-4115-810e-f0033869c342-etc-tuned\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.566858 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.566540 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67nn5\" (UniqueName: \"kubernetes.io/projected/0682191c-9cec-4f46-a400-6053e8f3e033-kube-api-access-67nn5\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:09.569418 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.569393 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzvvj\" (UniqueName: \"kubernetes.io/projected/ed3d3e6f-2e2c-4115-810e-f0033869c342-kube-api-access-pzvvj\") pod \"tuned-lnwpx\" (UID: \"ed3d3e6f-2e2c-4115-810e-f0033869c342\") " pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.569538 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.569442 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vllw9\" (UniqueName: \"kubernetes.io/projected/090876e6-05f9-4e60-9e0c-a5dddc8571af-kube-api-access-vllw9\") pod \"node-resolver-tzg8h\" (UID: \"090876e6-05f9-4e60-9e0c-a5dddc8571af\") " pod="openshift-dns/node-resolver-tzg8h" Jun 11 16:44:09.569893 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.569825 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpxdx\" (UniqueName: \"kubernetes.io/projected/1446fd9f-01f4-414c-9874-049aef85e422-kube-api-access-wpxdx\") pod \"multus-p98c6\" (UID: \"1446fd9f-01f4-414c-9874-049aef85e422\") " pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.571780 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.571761 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfstv\" (UniqueName: \"kubernetes.io/projected/964a13c0-b018-4d56-8c4a-850c6331d408-kube-api-access-dfstv\") pod \"iptables-alerter-452ql\" (UID: \"964a13c0-b018-4d56-8c4a-850c6331d408\") " pod="openshift-network-operator/iptables-alerter-452ql" Jun 11 16:44:09.572489 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.572473 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcnzh\" (UniqueName: \"kubernetes.io/projected/19f2fc50-546c-4a5f-9b9b-2e583e3923f7-kube-api-access-lcnzh\") pod \"multus-additional-cni-plugins-pw9xx\" (UID: \"19f2fc50-546c-4a5f-9b9b-2e583e3923f7\") " pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.661301 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-registration-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.661301 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b95027c8-1005-4bdf-b0cf-c095e8d14eb9-serviceca\") pod \"node-ca-n45kd\" (UID: \"b95027c8-1005-4bdf-b0cf-c095e8d14eb9\") " pod="openshift-image-registry/node-ca-n45kd" Jun 11 16:44:09.661301 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8wm9\" (UniqueName: \"kubernetes.io/projected/b95027c8-1005-4bdf-b0cf-c095e8d14eb9-kube-api-access-w8wm9\") pod \"node-ca-n45kd\" (UID: \"b95027c8-1005-4bdf-b0cf-c095e8d14eb9\") " pod="openshift-image-registry/node-ca-n45kd" Jun 11 16:44:09.661589 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661347 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-registration-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.661589 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661396 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb9c02ea-368b-4b3b-8de1-6930d11884c3-ovn-node-metrics-cert\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.661589 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-run-openvswitch\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.661589 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661495 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-run-openvswitch\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.661589 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb9c02ea-368b-4b3b-8de1-6930d11884c3-ovnkube-config\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.661888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-device-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.661888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb9c02ea-368b-4b3b-8de1-6930d11884c3-env-overrides\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.661888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.661888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-cni-bin\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.661888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661711 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.661888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-device-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.661888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-socket-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.661888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661764 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.661888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661777 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b95027c8-1005-4bdf-b0cf-c095e8d14eb9-serviceca\") pod \"node-ca-n45kd\" (UID: \"b95027c8-1005-4bdf-b0cf-c095e8d14eb9\") " pod="openshift-image-registry/node-ca-n45kd" Jun 11 16:44:09.661888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661846 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.661888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661894 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-cni-bin\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-kubelet\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661912 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-socket-dir\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661936 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-var-lib-openvswitch\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661962 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cm4b\" (UniqueName: \"kubernetes.io/projected/fb9c02ea-368b-4b3b-8de1-6930d11884c3-kube-api-access-5cm4b\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.661994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-run-netns\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlsbf\" (UniqueName: \"kubernetes.io/projected/71f1974b-b0b3-4e95-a28f-ecf316d56002-kube-api-access-mlsbf\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662034 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-kubelet\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9ss\" (UniqueName: \"kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss\") pod \"network-check-target-qgck5\" (UID: \"e318d141-fc7e-4509-9151-d606a86bb95d\") " pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-systemd-units\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-etc-openvswitch\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-run-ovn\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662155 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b95027c8-1005-4bdf-b0cf-c095e8d14eb9-host\") pod \"node-ca-n45kd\" (UID: \"b95027c8-1005-4bdf-b0cf-c095e8d14eb9\") " pod="openshift-image-registry/node-ca-n45kd" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-sys-fs\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662221 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb9c02ea-368b-4b3b-8de1-6930d11884c3-env-overrides\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb9c02ea-368b-4b3b-8de1-6930d11884c3-ovnkube-script-lib\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.662385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662276 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-var-lib-openvswitch\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662279 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-etc-openvswitch\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662306 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb9c02ea-368b-4b3b-8de1-6930d11884c3-ovnkube-config\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662347 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-run-ovn\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662395 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b95027c8-1005-4bdf-b0cf-c095e8d14eb9-host\") pod \"node-ca-n45kd\" (UID: \"b95027c8-1005-4bdf-b0cf-c095e8d14eb9\") " pod="openshift-image-registry/node-ca-n45kd" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662400 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-run-systemd\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662436 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-run-netns\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-cni-netd\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662514 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-cni-netd\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662520 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-slash\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-log-socket\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662558 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-run-systemd\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662571 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-node-log\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662613 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71f1974b-b0b3-4e95-a28f-ecf316d56002-sys-fs\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662624 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-slash\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662638 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-systemd-units\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663101 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662671 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-node-log\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663715 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662693 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663715 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662716 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb9c02ea-368b-4b3b-8de1-6930d11884c3-log-socket\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663715 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.662716 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb9c02ea-368b-4b3b-8de1-6930d11884c3-ovnkube-script-lib\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.663866 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.663845 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb9c02ea-368b-4b3b-8de1-6930d11884c3-ovn-node-metrics-cert\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.669354 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:09.669090 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:09.669354 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:09.669119 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:09.669354 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:09.669133 2580 projected.go:196] Error preparing data for projected volume kube-api-access-6k9ss for pod openshift-network-diagnostics/network-check-target-qgck5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:09.669354 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:09.669202 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss podName:e318d141-fc7e-4509-9151-d606a86bb95d nodeName:}" failed. No retries permitted until 2026-06-11 16:44:10.16918454 +0000 UTC m=+3.147660052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6k9ss" (UniqueName: "kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss") pod "network-check-target-qgck5" (UID: "e318d141-fc7e-4509-9151-d606a86bb95d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:09.670583 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.670565 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8wm9\" (UniqueName: \"kubernetes.io/projected/b95027c8-1005-4bdf-b0cf-c095e8d14eb9-kube-api-access-w8wm9\") pod \"node-ca-n45kd\" (UID: \"b95027c8-1005-4bdf-b0cf-c095e8d14eb9\") " pod="openshift-image-registry/node-ca-n45kd" Jun 11 16:44:09.670886 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.670861 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cm4b\" (UniqueName: \"kubernetes.io/projected/fb9c02ea-368b-4b3b-8de1-6930d11884c3-kube-api-access-5cm4b\") pod \"ovnkube-node-cd85h\" (UID: \"fb9c02ea-368b-4b3b-8de1-6930d11884c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:09.671572 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.671554 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlsbf\" (UniqueName: \"kubernetes.io/projected/71f1974b-b0b3-4e95-a28f-ecf316d56002-kube-api-access-mlsbf\") pod \"aws-ebs-csi-driver-node-m6mdc\" (UID: \"71f1974b-b0b3-4e95-a28f-ecf316d56002\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.743405 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.743373 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:09.751723 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.751702 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pw9xx" Jun 11 16:44:09.762294 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.762271 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p98c6" Jun 11 16:44:09.767463 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.767436 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-452ql" Jun 11 16:44:09.774808 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.774791 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tzg8h" Jun 11 16:44:09.780966 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.780948 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" Jun 11 16:44:09.786790 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.786762 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n45kd" Jun 11 16:44:09.794603 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.794579 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" Jun 11 16:44:09.800322 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:09.800302 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:10.066139 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.066073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:10.066139 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.066135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:10.066299 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:10.066240 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:10.066299 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:10.066254 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:10.066358 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:10.066316 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs podName:0682191c-9cec-4f46-a400-6053e8f3e033 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:11.066297214 +0000 UTC m=+4.044772724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs") pod "network-metrics-daemon-f226j" (UID: "0682191c-9cec-4f46-a400-6053e8f3e033") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:10.066358 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:10.066330 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret podName:822c473e-85e5-4340-8473-ad3f7f993dda nodeName:}" failed. No retries permitted until 2026-06-11 16:44:11.066324088 +0000 UTC m=+4.044799594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret") pod "global-pull-secret-syncer-k79r4" (UID: "822c473e-85e5-4340-8473-ad3f7f993dda") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:10.267022 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.266991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9ss\" (UniqueName: \"kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss\") pod \"network-check-target-qgck5\" (UID: \"e318d141-fc7e-4509-9151-d606a86bb95d\") " pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:10.267179 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:10.267127 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:10.267179 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:10.267143 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:10.267179 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:10.267157 2580 projected.go:196] Error preparing data for projected volume kube-api-access-6k9ss for pod openshift-network-diagnostics/network-check-target-qgck5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:10.267333 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:10.267211 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss podName:e318d141-fc7e-4509-9151-d606a86bb95d nodeName:}" failed. No retries permitted until 2026-06-11 16:44:11.267197115 +0000 UTC m=+4.245672626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k9ss" (UniqueName: "kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss") pod "network-check-target-qgck5" (UID: "e318d141-fc7e-4509-9151-d606a86bb95d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:10.413666 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:10.413639 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1446fd9f_01f4_414c_9874_049aef85e422.slice/crio-267039f5b07274e8616250396aff8357ea7e7602d5e0c633a621f84aa0a69722 WatchSource:0}: Error finding container 267039f5b07274e8616250396aff8357ea7e7602d5e0c633a621f84aa0a69722: Status 404 returned error can't find the container with id 267039f5b07274e8616250396aff8357ea7e7602d5e0c633a621f84aa0a69722 Jun 11 16:44:10.415470 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:10.415393 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3d3e6f_2e2c_4115_810e_f0033869c342.slice/crio-adfc7f48bc49b5c8463a3494bf5dba588bdb2a3b0bcee17237cb8bdfaf7be018 WatchSource:0}: Error finding container adfc7f48bc49b5c8463a3494bf5dba588bdb2a3b0bcee17237cb8bdfaf7be018: Status 404 returned error can't find the container with id adfc7f48bc49b5c8463a3494bf5dba588bdb2a3b0bcee17237cb8bdfaf7be018 Jun 11 16:44:10.417102 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:10.416680 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964a13c0_b018_4d56_8c4a_850c6331d408.slice/crio-997b9386ac6cef5b720e6e02ee44445579e8fb2f551466fae1b9821f139270d0 WatchSource:0}: Error finding container 997b9386ac6cef5b720e6e02ee44445579e8fb2f551466fae1b9821f139270d0: Status 404 returned error can't find the container with id 997b9386ac6cef5b720e6e02ee44445579e8fb2f551466fae1b9821f139270d0 Jun 11 16:44:10.419326 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:10.419306 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95027c8_1005_4bdf_b0cf_c095e8d14eb9.slice/crio-41c267087a9677444f355c10d49703ab0137417534c0eb9db3d91d682d71e0e5 WatchSource:0}: Error finding container 41c267087a9677444f355c10d49703ab0137417534c0eb9db3d91d682d71e0e5: Status 404 returned error can't find the container with id 41c267087a9677444f355c10d49703ab0137417534c0eb9db3d91d682d71e0e5 Jun 11 16:44:10.420008 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:10.419987 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f2fc50_546c_4a5f_9b9b_2e583e3923f7.slice/crio-74b6b2ab812a087253b17e41be581bc66006a03ec3e2fa3c8e94e0d8c691c498 WatchSource:0}: Error finding container 74b6b2ab812a087253b17e41be581bc66006a03ec3e2fa3c8e94e0d8c691c498: Status 404 returned error can't find the container with id 74b6b2ab812a087253b17e41be581bc66006a03ec3e2fa3c8e94e0d8c691c498 Jun 11 16:44:10.421031 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:10.421007 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b1dbe2_fe88_439f_9364_2b6d510dd976.slice/crio-b6fb46f504afeae34cb6ebb6aef54a8646dc95ed8731687d560885024ee3a7b6 WatchSource:0}: Error finding container b6fb46f504afeae34cb6ebb6aef54a8646dc95ed8731687d560885024ee3a7b6: Status 404 returned error can't find the container with id b6fb46f504afeae34cb6ebb6aef54a8646dc95ed8731687d560885024ee3a7b6 Jun 11 16:44:10.422489 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:10.422440 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f1974b_b0b3_4e95_a28f_ecf316d56002.slice/crio-0a030966fa123aa1ae41bc90e4072c2a48fc69eb97734f194f5ec8f40cd7bc6e WatchSource:0}: Error finding container 0a030966fa123aa1ae41bc90e4072c2a48fc69eb97734f194f5ec8f40cd7bc6e: Status 404 returned error can't find the container with id 0a030966fa123aa1ae41bc90e4072c2a48fc69eb97734f194f5ec8f40cd7bc6e Jun 11 16:44:10.424573 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:10.424439 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090876e6_05f9_4e60_9e0c_a5dddc8571af.slice/crio-7fd253e2950f541e89afe199dd00be0be062e8724af79dc80908674396a62686 WatchSource:0}: Error finding container 7fd253e2950f541e89afe199dd00be0be062e8724af79dc80908674396a62686: Status 404 returned error can't find the container with id 7fd253e2950f541e89afe199dd00be0be062e8724af79dc80908674396a62686 Jun 11 16:44:10.489736 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.489694 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:39:09 +0000 UTC" deadline="2028-01-08 19:05:19.948203545 +0000 UTC" Jun 11 16:44:10.489736 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.489733 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13826h21m9.458472643s" Jun 11 16:44:10.516324 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.516302 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:10.516417 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:10.516399 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:10.516486 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.516429 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:10.516532 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:10.516506 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:10.524238 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.524210 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x5zjm" event={"ID":"76b1dbe2-fe88-439f-9364-2b6d510dd976","Type":"ContainerStarted","Data":"b6fb46f504afeae34cb6ebb6aef54a8646dc95ed8731687d560885024ee3a7b6"} Jun 11 16:44:10.525297 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.525276 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pw9xx" event={"ID":"19f2fc50-546c-4a5f-9b9b-2e583e3923f7","Type":"ContainerStarted","Data":"74b6b2ab812a087253b17e41be581bc66006a03ec3e2fa3c8e94e0d8c691c498"} Jun 11 16:44:10.526630 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.526607 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" event={"ID":"ed3d3e6f-2e2c-4115-810e-f0033869c342","Type":"ContainerStarted","Data":"adfc7f48bc49b5c8463a3494bf5dba588bdb2a3b0bcee17237cb8bdfaf7be018"} Jun 11 16:44:10.528390 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.528368 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-76.ec2.internal" event={"ID":"6a27aac0db19b06d35dee5533ce37c71","Type":"ContainerStarted","Data":"464fae67199aa5150bdd1d89735f91f17fcaf10cbcebc552e4f2367e3644ea91"} Jun 11 16:44:10.529574 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.529554 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" event={"ID":"fb9c02ea-368b-4b3b-8de1-6930d11884c3","Type":"ContainerStarted","Data":"c2c21565ce101209bdd2dae6d6ce64b7f64f08245785734a41c16f824ccdfc9c"} Jun 11 16:44:10.530676 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.530655 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" event={"ID":"71f1974b-b0b3-4e95-a28f-ecf316d56002","Type":"ContainerStarted","Data":"0a030966fa123aa1ae41bc90e4072c2a48fc69eb97734f194f5ec8f40cd7bc6e"} Jun 11 16:44:10.531810 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.531786 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n45kd" event={"ID":"b95027c8-1005-4bdf-b0cf-c095e8d14eb9","Type":"ContainerStarted","Data":"41c267087a9677444f355c10d49703ab0137417534c0eb9db3d91d682d71e0e5"} Jun 11 16:44:10.533018 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.532999 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-452ql" event={"ID":"964a13c0-b018-4d56-8c4a-850c6331d408","Type":"ContainerStarted","Data":"997b9386ac6cef5b720e6e02ee44445579e8fb2f551466fae1b9821f139270d0"} Jun 11 16:44:10.534068 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.534047 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p98c6" event={"ID":"1446fd9f-01f4-414c-9874-049aef85e422","Type":"ContainerStarted","Data":"267039f5b07274e8616250396aff8357ea7e7602d5e0c633a621f84aa0a69722"} Jun 11 16:44:10.535259 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:10.535232 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tzg8h" event={"ID":"090876e6-05f9-4e60-9e0c-a5dddc8571af","Type":"ContainerStarted","Data":"7fd253e2950f541e89afe199dd00be0be062e8724af79dc80908674396a62686"} Jun 11 16:44:11.072137 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:11.072050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:11.072137 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:11.072110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:11.072364 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:11.072272 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:11.072364 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:11.072328 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret podName:822c473e-85e5-4340-8473-ad3f7f993dda nodeName:}" failed. No retries permitted until 2026-06-11 16:44:13.072310379 +0000 UTC m=+6.050785908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret") pod "global-pull-secret-syncer-k79r4" (UID: "822c473e-85e5-4340-8473-ad3f7f993dda") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:11.072826 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:11.072732 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:11.072826 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:11.072786 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs podName:0682191c-9cec-4f46-a400-6053e8f3e033 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:13.07276957 +0000 UTC m=+6.051245094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs") pod "network-metrics-daemon-f226j" (UID: "0682191c-9cec-4f46-a400-6053e8f3e033") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:11.273792 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:11.273714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9ss\" (UniqueName: \"kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss\") pod \"network-check-target-qgck5\" (UID: \"e318d141-fc7e-4509-9151-d606a86bb95d\") " pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:11.273973 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:11.273912 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:11.273973 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:11.273931 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:11.273973 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:11.273944 2580 projected.go:196] Error preparing data for projected volume kube-api-access-6k9ss for pod openshift-network-diagnostics/network-check-target-qgck5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:11.274120 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:11.274001 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss podName:e318d141-fc7e-4509-9151-d606a86bb95d nodeName:}" failed. No retries permitted until 2026-06-11 16:44:13.273982555 +0000 UTC m=+6.252458067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k9ss" (UniqueName: "kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss") pod "network-check-target-qgck5" (UID: "e318d141-fc7e-4509-9151-d606a86bb95d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:11.490832 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:11.490722 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:39:09 +0000 UTC" deadline="2027-12-28 15:32:13.294823935 +0000 UTC" Jun 11 16:44:11.490832 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:11.490761 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13558h48m1.804067757s" Jun 11 16:44:11.518417 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:11.517842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:11.518417 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:11.517962 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:11.556690 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:11.555772 2580 generic.go:356] "Generic (PLEG): container finished" podID="237712fb2fccf60cb12027310385dc0d" containerID="e0f850fe7a83d22c96915d43873415bfe65825bc7a20025ff11e609c4f443078" exitCode=0 Jun 11 16:44:11.556690 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:11.556635 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" event={"ID":"237712fb2fccf60cb12027310385dc0d","Type":"ContainerDied","Data":"e0f850fe7a83d22c96915d43873415bfe65825bc7a20025ff11e609c4f443078"} Jun 11 16:44:11.574298 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:11.574248 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-76.ec2.internal" podStartSLOduration=3.5742297560000003 podStartE2EDuration="3.574229756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:10.542565271 +0000 UTC m=+3.521040800" watchObservedRunningTime="2026-06-11 16:44:11.574229756 +0000 UTC m=+4.552705310" Jun 11 16:44:12.516339 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:12.516305 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:12.516817 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:12.516441 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:12.516892 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:12.516826 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:12.516948 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:12.516931 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:12.576342 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:12.575594 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" event={"ID":"237712fb2fccf60cb12027310385dc0d","Type":"ContainerStarted","Data":"304a6c1464a40238f29d6d2cb57be4d0ad5b5d2c50bb3b4b0a8123196258811f"} Jun 11 16:44:13.090202 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:13.090158 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:13.090387 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:13.090255 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:13.090387 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:13.090333 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:13.090387 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:13.090358 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:13.090609 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:13.090405 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret podName:822c473e-85e5-4340-8473-ad3f7f993dda nodeName:}" failed. No retries permitted until 2026-06-11 16:44:17.090384063 +0000 UTC m=+10.068859574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret") pod "global-pull-secret-syncer-k79r4" (UID: "822c473e-85e5-4340-8473-ad3f7f993dda") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:13.090609 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:13.090426 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs podName:0682191c-9cec-4f46-a400-6053e8f3e033 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:17.090415572 +0000 UTC m=+10.068891084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs") pod "network-metrics-daemon-f226j" (UID: "0682191c-9cec-4f46-a400-6053e8f3e033") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:13.292062 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:13.292024 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9ss\" (UniqueName: \"kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss\") pod \"network-check-target-qgck5\" (UID: \"e318d141-fc7e-4509-9151-d606a86bb95d\") " pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:13.292250 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:13.292234 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:13.292321 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:13.292256 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:13.292321 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:13.292269 2580 projected.go:196] Error preparing data for projected volume kube-api-access-6k9ss for pod openshift-network-diagnostics/network-check-target-qgck5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:13.292423 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:13.292330 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss podName:e318d141-fc7e-4509-9151-d606a86bb95d nodeName:}" failed. No retries permitted until 2026-06-11 16:44:17.292310686 +0000 UTC m=+10.270786207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k9ss" (UniqueName: "kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss") pod "network-check-target-qgck5" (UID: "e318d141-fc7e-4509-9151-d606a86bb95d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:13.516303 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:13.515848 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:13.516303 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:13.515965 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:14.516384 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:14.515773 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:14.516384 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:14.515896 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:14.516384 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:14.516258 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:14.516384 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:14.516338 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:15.515669 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:15.515636 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:15.515856 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:15.515761 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:16.516490 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:16.515987 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:16.516490 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:16.516005 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:16.516490 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:16.516117 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:16.516490 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:16.516158 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:17.127603 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:17.127572 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:17.127800 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:17.127619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:17.127800 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:17.127731 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:17.127800 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:17.127791 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret podName:822c473e-85e5-4340-8473-ad3f7f993dda nodeName:}" failed. No retries permitted until 2026-06-11 16:44:25.127773265 +0000 UTC m=+18.106248772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret") pod "global-pull-secret-syncer-k79r4" (UID: "822c473e-85e5-4340-8473-ad3f7f993dda") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:17.128197 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:17.128178 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:17.128316 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:17.128238 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs podName:0682191c-9cec-4f46-a400-6053e8f3e033 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:25.128223384 +0000 UTC m=+18.106698890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs") pod "network-metrics-daemon-f226j" (UID: "0682191c-9cec-4f46-a400-6053e8f3e033") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:17.329584 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:17.329545 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9ss\" (UniqueName: \"kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss\") pod \"network-check-target-qgck5\" (UID: \"e318d141-fc7e-4509-9151-d606a86bb95d\") " pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:17.329584 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:17.329708 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:17.329584 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:17.329731 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:17.329584 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:17.329744 2580 projected.go:196] Error preparing data for projected volume kube-api-access-6k9ss for pod openshift-network-diagnostics/network-check-target-qgck5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:17.329584 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:17.329805 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss podName:e318d141-fc7e-4509-9151-d606a86bb95d nodeName:}" failed. No retries permitted until 2026-06-11 16:44:25.329786468 +0000 UTC m=+18.308261978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k9ss" (UniqueName: "kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss") pod "network-check-target-qgck5" (UID: "e318d141-fc7e-4509-9151-d606a86bb95d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:17.518202 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:17.517709 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:17.518202 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:17.517849 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:18.515861 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:18.515822 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:18.516142 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:18.515845 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:18.516142 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:18.515940 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:18.516142 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:18.516035 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:19.518121 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:19.517645 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:19.518121 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:19.517783 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:20.516426 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:20.516393 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:20.516605 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:20.516392 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:20.516605 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:20.516550 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:20.516708 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:20.516678 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:21.516397 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:21.516359 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:21.516845 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:21.516502 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:22.515648 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:22.515614 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:22.515834 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:22.515625 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:22.515834 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:22.515740 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:22.515938 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:22.515833 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:23.516279 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:23.516244 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:23.516701 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:23.516355 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:24.515666 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:24.515633 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:24.515838 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:24.515757 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:24.515838 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:24.515819 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:24.515925 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:24.515911 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:25.186519 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:25.186473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:25.186958 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:25.186536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:25.186958 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:25.186623 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:25.186958 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:25.186653 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:25.186958 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:25.186688 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs podName:0682191c-9cec-4f46-a400-6053e8f3e033 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:41.186670374 +0000 UTC m=+34.165145880 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs") pod "network-metrics-daemon-f226j" (UID: "0682191c-9cec-4f46-a400-6053e8f3e033") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:25.186958 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:25.186709 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret podName:822c473e-85e5-4340-8473-ad3f7f993dda nodeName:}" failed. No retries permitted until 2026-06-11 16:44:41.186698797 +0000 UTC m=+34.165174303 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret") pod "global-pull-secret-syncer-k79r4" (UID: "822c473e-85e5-4340-8473-ad3f7f993dda") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:25.388260 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:25.388222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9ss\" (UniqueName: \"kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss\") pod \"network-check-target-qgck5\" (UID: \"e318d141-fc7e-4509-9151-d606a86bb95d\") " pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:25.388467 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:25.388379 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:25.388467 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:25.388398 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:25.388467 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:25.388411 2580 projected.go:196] Error preparing data for projected volume kube-api-access-6k9ss for pod openshift-network-diagnostics/network-check-target-qgck5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:25.388619 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:25.388485 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss podName:e318d141-fc7e-4509-9151-d606a86bb95d nodeName:}" failed. No retries permitted until 2026-06-11 16:44:41.388464966 +0000 UTC m=+34.366940493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k9ss" (UniqueName: "kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss") pod "network-check-target-qgck5" (UID: "e318d141-fc7e-4509-9151-d606a86bb95d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:25.516283 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:25.516198 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:25.516430 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:25.516327 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:26.516525 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:26.516492 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:26.516525 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:26.516537 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:26.517036 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:26.516646 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:26.517036 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:26.516749 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:27.516609 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:27.516573 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:27.516949 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:27.516725 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:28.516265 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:28.516232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:28.516423 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:28.516354 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:28.516715 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:28.516694 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:28.517008 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:28.516810 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:29.516503 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:29.516280 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:29.516641 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:29.516618 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:29.628612 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:29.628498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" event={"ID":"ed3d3e6f-2e2c-4115-810e-f0033869c342","Type":"ContainerStarted","Data":"a1e793e5831e7581ad709dc1583007dad9cf2ea07d865fc64d20d4eb19af4050"} Jun 11 16:44:29.632345 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:29.632299 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x5zjm" event={"ID":"76b1dbe2-fe88-439f-9364-2b6d510dd976","Type":"ContainerStarted","Data":"43d542b55af61336e3d78bb3dd67e5a21fa7ae47d3a5d47cd1e807f1918535d2"} Jun 11 16:44:29.649291 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:29.648582 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-76.ec2.internal" podStartSLOduration=21.648563794 podStartE2EDuration="21.648563794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:12.591403078 +0000 UTC m=+5.569878797" watchObservedRunningTime="2026-06-11 16:44:29.648563794 +0000 UTC m=+22.627039331" Jun 11 16:44:29.649291 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:29.648904 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x5zjm" podStartSLOduration=8.259845941 podStartE2EDuration="22.648896298s" totalImagesPullingTime="14.389050357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:29.647761275 +0000 UTC m=+22.626236804" watchObservedRunningTime="2026-06-11 16:44:29.648896298 +0000 UTC m=+22.627371827" Jun 11 16:44:29.732402 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:29.732246 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:29.732749 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:29.732735 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:30.516144 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.516117 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:30.516343 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.516165 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:30.516343 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:30.516274 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:30.516484 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:30.516386 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:30.642112 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.642088 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 16:44:30.642528 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.642424 2580 generic.go:356] "Generic (PLEG): container finished" podID="fb9c02ea-368b-4b3b-8de1-6930d11884c3" containerID="22d07e93903d7dae58fef4a66462b142fd4062101e3e523b7acc06f4ac637238" exitCode=1 Jun 11 16:44:30.642528 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.642494 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" event={"ID":"fb9c02ea-368b-4b3b-8de1-6930d11884c3","Type":"ContainerStarted","Data":"2b40dac7cc7f2079a10d641c49d22c480488759a00275559465987a5f62a310c"} Jun 11 16:44:30.642610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.642578 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" event={"ID":"fb9c02ea-368b-4b3b-8de1-6930d11884c3","Type":"ContainerStarted","Data":"4cdd74fbd44443ac1018eca7b01b32bf46a56541066fbd5ae0934ef5e9657923"} Jun 11 16:44:30.642644 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.642631 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" event={"ID":"fb9c02ea-368b-4b3b-8de1-6930d11884c3","Type":"ContainerStarted","Data":"6422659777b00d4d39f81c16daba8627fb03b20c5511449092fa76e3d4293e75"} Jun 11 16:44:30.642694 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.642681 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" event={"ID":"fb9c02ea-368b-4b3b-8de1-6930d11884c3","Type":"ContainerStarted","Data":"79a4e68a59afb6ff9fe426aee6c9311154227d741bfae56b0b92ae0624b10a70"} Jun 11 16:44:30.642732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.642716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" event={"ID":"fb9c02ea-368b-4b3b-8de1-6930d11884c3","Type":"ContainerDied","Data":"22d07e93903d7dae58fef4a66462b142fd4062101e3e523b7acc06f4ac637238"} Jun 11 16:44:30.642769 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.642753 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" event={"ID":"fb9c02ea-368b-4b3b-8de1-6930d11884c3","Type":"ContainerStarted","Data":"bc9dc2e989e2d65ced6615165616378b5dec2ba7bf3b47fa459d1243e23c3735"} Jun 11 16:44:30.643821 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.643800 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" event={"ID":"71f1974b-b0b3-4e95-a28f-ecf316d56002","Type":"ContainerStarted","Data":"3b25e904d2aea329978f21613c1934f21812a929429536e48bf4faa154a3818b"} Jun 11 16:44:30.645048 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.645029 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n45kd" event={"ID":"b95027c8-1005-4bdf-b0cf-c095e8d14eb9","Type":"ContainerStarted","Data":"53a486082525e882a6f6df21723bbcd1bde12ff0c6ebf2d24082258b07ccb216"} Jun 11 16:44:30.646231 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.646212 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p98c6" event={"ID":"1446fd9f-01f4-414c-9874-049aef85e422","Type":"ContainerStarted","Data":"e993dd6a87dc0284460a23114b7929409cb29afcd8b6914601cd741544c2c6a1"} Jun 11 16:44:30.647608 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.647585 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tzg8h" event={"ID":"090876e6-05f9-4e60-9e0c-a5dddc8571af","Type":"ContainerStarted","Data":"d1e23653e6410f44275edaf16569f62a33f3095359445ee9f2dc86723a665ac6"} Jun 11 16:44:30.649104 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.649084 2580 generic.go:356] "Generic (PLEG): container finished" podID="19f2fc50-546c-4a5f-9b9b-2e583e3923f7" containerID="5ac72e9b7fb0531e47fd9778b3b576f4ff114c3257378b4121cac0c1f8818cd1" exitCode=0 Jun 11 16:44:30.649200 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.649108 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pw9xx" event={"ID":"19f2fc50-546c-4a5f-9b9b-2e583e3923f7","Type":"ContainerDied","Data":"5ac72e9b7fb0531e47fd9778b3b576f4ff114c3257378b4121cac0c1f8818cd1"} Jun 11 16:44:30.652234 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.650200 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:30.652995 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.652747 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x5zjm" Jun 11 16:44:30.674146 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.674104 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n45kd" podStartSLOduration=4.653009231 podStartE2EDuration="23.674090845s" totalImagesPullingTime="19.021081614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:30.660755649 +0000 UTC m=+23.639231189" watchObservedRunningTime="2026-06-11 16:44:30.674090845 +0000 UTC m=+23.652566374" Jun 11 16:44:30.674420 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.674400 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tzg8h" podStartSLOduration=4.653390775 podStartE2EDuration="23.674392542s" totalImagesPullingTime="19.021001767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:30.67405021 +0000 UTC m=+23.652525736" watchObservedRunningTime="2026-06-11 16:44:30.674392542 +0000 UTC m=+23.652868071" Jun 11 16:44:30.712244 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.712208 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lnwpx" podStartSLOduration=4.685069631 podStartE2EDuration="23.712197497s" totalImagesPullingTime="19.027127866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:30.689762746 +0000 UTC m=+23.668238276" watchObservedRunningTime="2026-06-11 16:44:30.712197497 +0000 UTC m=+23.690673063" Jun 11 16:44:30.746999 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.746931 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p98c6" podStartSLOduration=4.69527933 podStartE2EDuration="23.74692039s" totalImagesPullingTime="19.05164106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:30.746751925 +0000 UTC m=+23.725227454" watchObservedRunningTime="2026-06-11 16:44:30.74692039 +0000 UTC m=+23.725395920" Jun 11 16:44:30.950866 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:30.950729 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:44:31.511655 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:31.510877 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:44:30.950861611Z","UUID":"724df509-4cc6-4bb6-8ebd-9bbd3fcb06cc","Handler":null,"Name":"","Endpoint":""} Jun 11 16:44:31.512778 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:31.512752 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:44:31.512879 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:31.512800 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:44:31.515553 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:31.515529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:31.515665 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:31.515641 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:31.654401 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:31.654358 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" event={"ID":"71f1974b-b0b3-4e95-a28f-ecf316d56002","Type":"ContainerStarted","Data":"015ddaf2793c78ec8375a9d9753a53e72c101081f09bb8f02d8db2fadf3c5513"} Jun 11 16:44:31.656284 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:31.656254 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-452ql" event={"ID":"964a13c0-b018-4d56-8c4a-850c6331d408","Type":"ContainerStarted","Data":"44a8bc10c0e652e8bfe4fc4f236064c5b4dd237b01dfa6931fd382d89e1023bd"} Jun 11 16:44:31.674552 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:31.674031 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-452ql" podStartSLOduration=5.667261043 podStartE2EDuration="24.674011664s" totalImagesPullingTime="19.006750621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:31.673412073 +0000 UTC m=+24.651887604" watchObservedRunningTime="2026-06-11 16:44:31.674011664 +0000 UTC m=+24.652487194" Jun 11 16:44:32.515794 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:32.515708 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:32.515942 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:32.515843 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:32.515942 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:32.515896 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:32.516051 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:32.515996 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:32.661752 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:32.661724 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 16:44:32.662358 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:32.662096 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" event={"ID":"fb9c02ea-368b-4b3b-8de1-6930d11884c3","Type":"ContainerStarted","Data":"60a042623babe33582d987869b0fcd7b4903403afe279e2d9b5b0156e79e94de"} Jun 11 16:44:32.664351 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:32.664322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" event={"ID":"71f1974b-b0b3-4e95-a28f-ecf316d56002","Type":"ContainerStarted","Data":"484d63c49d10a2212a6cab5ddeaf568469dfe3d76e3f153b019bdba0107bddb9"} Jun 11 16:44:32.688865 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:32.688818 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6mdc" podStartSLOduration=4.776123148 podStartE2EDuration="25.688799388s" totalImagesPullingTime="20.91267624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:32.688038023 +0000 UTC m=+25.666513551" watchObservedRunningTime="2026-06-11 16:44:32.688799388 +0000 UTC m=+25.667274925" Jun 11 16:44:33.516596 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:33.516568 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:33.516782 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:33.516700 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:34.515595 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:34.515522 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:34.516221 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:34.515522 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:34.516221 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:34.515634 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:34.516221 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:34.515739 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:35.516525 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:35.516332 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:35.516929 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:35.516591 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:35.671513 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:35.671483 2580 generic.go:356] "Generic (PLEG): container finished" podID="19f2fc50-546c-4a5f-9b9b-2e583e3923f7" containerID="bbaec17a9fa2a7c0e4adf9b149214ba5f8dba21da82b1fb90ac8367724b1bf77" exitCode=0 Jun 11 16:44:35.671686 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:35.671582 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pw9xx" event={"ID":"19f2fc50-546c-4a5f-9b9b-2e583e3923f7","Type":"ContainerDied","Data":"bbaec17a9fa2a7c0e4adf9b149214ba5f8dba21da82b1fb90ac8367724b1bf77"} Jun 11 16:44:35.675463 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:35.675431 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 16:44:35.675837 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:35.675815 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" event={"ID":"fb9c02ea-368b-4b3b-8de1-6930d11884c3","Type":"ContainerStarted","Data":"9f800843dfacd771f43d6a5bf9b2fb965500e7f697b71320942a42039b045078"} Jun 11 16:44:35.676066 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:35.676040 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:35.676153 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:35.676097 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:35.676224 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:35.676196 2580 scope.go:117] "RemoveContainer" containerID="22d07e93903d7dae58fef4a66462b142fd4062101e3e523b7acc06f4ac637238" Jun 11 16:44:35.693250 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:35.693231 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:36.516402 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.516380 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:36.516402 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.516400 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:36.516541 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:36.516501 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:36.516796 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:36.516620 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:36.680775 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.680607 2580 generic.go:356] "Generic (PLEG): container finished" podID="19f2fc50-546c-4a5f-9b9b-2e583e3923f7" containerID="a6847d5dc2b13ea2d5b7cbb33e7c7c5558f7fbe17e99af3f5231f4c240ff4c7f" exitCode=0 Jun 11 16:44:36.680917 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.680679 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pw9xx" event={"ID":"19f2fc50-546c-4a5f-9b9b-2e583e3923f7","Type":"ContainerDied","Data":"a6847d5dc2b13ea2d5b7cbb33e7c7c5558f7fbe17e99af3f5231f4c240ff4c7f"} Jun 11 16:44:36.684595 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.684578 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 16:44:36.684952 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.684932 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" event={"ID":"fb9c02ea-368b-4b3b-8de1-6930d11884c3","Type":"ContainerStarted","Data":"e331f730ba8c7212bfb7bb5daec050c0a1140d5bd7b90556c140c6d204dfe0d6"} Jun 11 16:44:36.686483 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.686427 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:36.700993 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.700975 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:44:36.733764 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.733719 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" podStartSLOduration=10.660276351 podStartE2EDuration="29.733704803s" totalImagesPullingTime="19.073428452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:36.732668062 +0000 UTC m=+29.711143612" watchObservedRunningTime="2026-06-11 16:44:36.733704803 +0000 UTC m=+29.712180331" Jun 11 16:44:36.830988 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.830945 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k79r4"] Jun 11 16:44:36.831130 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.831116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:36.831253 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:36.831233 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:36.831665 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.831643 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qgck5"] Jun 11 16:44:36.831769 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.831722 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:36.831830 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:36.831788 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:36.832217 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.832198 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f226j"] Jun 11 16:44:36.832317 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:36.832286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:36.832405 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:36.832389 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:37.689140 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:37.689108 2580 generic.go:356] "Generic (PLEG): container finished" podID="19f2fc50-546c-4a5f-9b9b-2e583e3923f7" containerID="b863b8936ad04c0b392de1c27882b9dbd9b765319473e88ba9d87a51571edc1c" exitCode=0 Jun 11 16:44:37.689689 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:37.689193 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pw9xx" event={"ID":"19f2fc50-546c-4a5f-9b9b-2e583e3923f7","Type":"ContainerDied","Data":"b863b8936ad04c0b392de1c27882b9dbd9b765319473e88ba9d87a51571edc1c"} Jun 11 16:44:38.515695 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:38.515660 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:38.515695 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:38.515698 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:38.515881 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:38.515667 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:38.515881 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:38.515791 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:38.515881 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:38.515841 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:38.516061 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:38.516038 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:39.510787 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:39.510757 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:39.657407 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:39.657364 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:40.381877 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:40.381842 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:40.453541 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:40.453484 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:40.515626 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:40.515591 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:40.516078 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:40.515638 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:40.516078 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:40.515704 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:40.516078 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:40.515723 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:44:40.516078 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:40.515794 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k79r4" podUID="822c473e-85e5-4340-8473-ad3f7f993dda" Jun 11 16:44:40.516078 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:40.515889 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgck5" podUID="e318d141-fc7e-4509-9151-d606a86bb95d" Jun 11 16:44:41.201756 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:41.201719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:41.201960 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:41.201770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:41.201960 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:41.201873 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:41.201960 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:41.201878 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:41.201960 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:41.201932 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret podName:822c473e-85e5-4340-8473-ad3f7f993dda nodeName:}" failed. No retries permitted until 2026-06-11 16:45:13.201916733 +0000 UTC m=+66.180392259 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret") pod "global-pull-secret-syncer-k79r4" (UID: "822c473e-85e5-4340-8473-ad3f7f993dda") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:41.201960 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:41.201949 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs podName:0682191c-9cec-4f46-a400-6053e8f3e033 nodeName:}" failed. No retries permitted until 2026-06-11 16:45:13.201939912 +0000 UTC m=+66.180415419 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs") pod "network-metrics-daemon-f226j" (UID: "0682191c-9cec-4f46-a400-6053e8f3e033") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:41.403015 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:41.402982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9ss\" (UniqueName: \"kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss\") pod \"network-check-target-qgck5\" (UID: \"e318d141-fc7e-4509-9151-d606a86bb95d\") " pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:41.403233 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:41.403190 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:41.403233 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:41.403210 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:41.403233 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:41.403218 2580 projected.go:196] Error preparing data for projected volume kube-api-access-6k9ss for pod openshift-network-diagnostics/network-check-target-qgck5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:41.403389 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:41.403269 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss podName:e318d141-fc7e-4509-9151-d606a86bb95d nodeName:}" failed. No retries permitted until 2026-06-11 16:45:13.403255489 +0000 UTC m=+66.381730997 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k9ss" (UniqueName: "kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss") pod "network-check-target-qgck5" (UID: "e318d141-fc7e-4509-9151-d606a86bb95d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:42.286578 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.286550 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-76.ec2.internal" event="NodeReady" Jun 11 16:44:42.286899 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.286672 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:44:42.336092 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.336027 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fd824"] Jun 11 16:44:42.350003 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.349984 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qbhdp"] Jun 11 16:44:42.350152 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.350130 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fd824" Jun 11 16:44:42.353246 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.353051 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:44:42.353626 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.353605 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:44:42.353728 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.353642 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:44:42.353728 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.353698 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-428pv\"" Jun 11 16:44:42.369621 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.369602 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fd824"] Jun 11 16:44:42.369723 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.369632 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qbhdp"] Jun 11 16:44:42.369723 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.369707 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.372336 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.372318 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d9x4d\"" Jun 11 16:44:42.372662 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.372643 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:44:42.372662 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.372659 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:44:42.475525 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.475494 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:42.511030 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.511006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.511167 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.511032 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-config-volume\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.511167 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.511051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfjxl\" (UniqueName: \"kubernetes.io/projected/49e31301-ebf6-493b-91e9-2525a50c4dd6-kube-api-access-xfjxl\") pod \"ingress-canary-fd824\" (UID: \"49e31301-ebf6-493b-91e9-2525a50c4dd6\") " pod="openshift-ingress-canary/ingress-canary-fd824" Jun 11 16:44:42.511167 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.511067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-tmp-dir\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.511167 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.511120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75gsl\" (UniqueName: \"kubernetes.io/projected/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-kube-api-access-75gsl\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.511293 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.511195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49e31301-ebf6-493b-91e9-2525a50c4dd6-cert\") pod \"ingress-canary-fd824\" (UID: \"49e31301-ebf6-493b-91e9-2525a50c4dd6\") " pod="openshift-ingress-canary/ingress-canary-fd824" Jun 11 16:44:42.516108 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.516091 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:44:42.516196 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.516091 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:44:42.516321 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.516091 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:44:42.518843 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.518825 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:44:42.518998 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.518984 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:44:42.519090 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.519071 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mwddw\"" Jun 11 16:44:42.519237 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.519221 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:44:42.519544 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.519519 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:44:42.519631 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.519616 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bmxfr\"" Jun 11 16:44:42.577053 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.577021 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:42.612123 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.612103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.612230 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.612129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-config-volume\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.612230 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.612157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfjxl\" (UniqueName: \"kubernetes.io/projected/49e31301-ebf6-493b-91e9-2525a50c4dd6-kube-api-access-xfjxl\") pod \"ingress-canary-fd824\" (UID: \"49e31301-ebf6-493b-91e9-2525a50c4dd6\") " pod="openshift-ingress-canary/ingress-canary-fd824" Jun 11 16:44:42.612230 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.612172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-tmp-dir\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.612230 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.612199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75gsl\" (UniqueName: \"kubernetes.io/projected/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-kube-api-access-75gsl\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.612421 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:42.612265 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:44:42.612421 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:42.612331 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls podName:99d2f1d8-f3f3-4c6f-97f0-c768caae1caf nodeName:}" failed. No retries permitted until 2026-06-11 16:44:43.112308453 +0000 UTC m=+36.090783963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls") pod "dns-default-qbhdp" (UID: "99d2f1d8-f3f3-4c6f-97f0-c768caae1caf") : secret "dns-default-metrics-tls" not found Jun 11 16:44:42.612421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.612375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49e31301-ebf6-493b-91e9-2525a50c4dd6-cert\") pod \"ingress-canary-fd824\" (UID: \"49e31301-ebf6-493b-91e9-2525a50c4dd6\") " pod="openshift-ingress-canary/ingress-canary-fd824" Jun 11 16:44:42.612609 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.612594 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-tmp-dir\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.612803 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.612778 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-config-volume\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.616599 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.616579 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49e31301-ebf6-493b-91e9-2525a50c4dd6-cert\") pod \"ingress-canary-fd824\" (UID: \"49e31301-ebf6-493b-91e9-2525a50c4dd6\") " pod="openshift-ingress-canary/ingress-canary-fd824" Jun 11 16:44:42.622347 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.622323 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75gsl\" (UniqueName: \"kubernetes.io/projected/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-kube-api-access-75gsl\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:42.622543 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.622528 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfjxl\" (UniqueName: \"kubernetes.io/projected/49e31301-ebf6-493b-91e9-2525a50c4dd6-kube-api-access-xfjxl\") pod \"ingress-canary-fd824\" (UID: \"49e31301-ebf6-493b-91e9-2525a50c4dd6\") " pod="openshift-ingress-canary/ingress-canary-fd824" Jun 11 16:44:42.659072 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.659045 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fd824" Jun 11 16:44:42.704348 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.704318 2580 generic.go:356] "Generic (PLEG): container finished" podID="19f2fc50-546c-4a5f-9b9b-2e583e3923f7" containerID="f9d220a931cad2f3af9bb3a21f2a12a821e45299e5dfd65fb4746b79ee8edef7" exitCode=0 Jun 11 16:44:42.704439 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.704368 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pw9xx" event={"ID":"19f2fc50-546c-4a5f-9b9b-2e583e3923f7","Type":"ContainerDied","Data":"f9d220a931cad2f3af9bb3a21f2a12a821e45299e5dfd65fb4746b79ee8edef7"} Jun 11 16:44:42.845230 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.845202 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fd824"] Jun 11 16:44:42.850130 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:44:42.850107 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e31301_ebf6_493b_91e9_2525a50c4dd6.slice/crio-510d6139e32e18bcdbd491665d7bddd63abc07e92844fa37f017d550750af5f6 WatchSource:0}: Error finding container 510d6139e32e18bcdbd491665d7bddd63abc07e92844fa37f017d550750af5f6: Status 404 returned error can't find the container with id 510d6139e32e18bcdbd491665d7bddd63abc07e92844fa37f017d550750af5f6 Jun 11 16:44:42.942203 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:42.942176 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:43.042394 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:43.042364 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:43.104117 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:43.104087 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:43.117266 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:43.117244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:43.117347 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:43.117335 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:44:43.117402 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:43.117393 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls podName:99d2f1d8-f3f3-4c6f-97f0-c768caae1caf nodeName:}" failed. No retries permitted until 2026-06-11 16:44:44.117380472 +0000 UTC m=+37.095855980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls") pod "dns-default-qbhdp" (UID: "99d2f1d8-f3f3-4c6f-97f0-c768caae1caf") : secret "dns-default-metrics-tls" not found Jun 11 16:44:43.708518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:43.708479 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fd824" event={"ID":"49e31301-ebf6-493b-91e9-2525a50c4dd6","Type":"ContainerStarted","Data":"510d6139e32e18bcdbd491665d7bddd63abc07e92844fa37f017d550750af5f6"} Jun 11 16:44:43.711929 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:43.711901 2580 generic.go:356] "Generic (PLEG): container finished" podID="19f2fc50-546c-4a5f-9b9b-2e583e3923f7" containerID="7cb9a16b2779148e4b5266b2aa290f587c82259ef8cfe268bafd88d9acb9dbbd" exitCode=0 Jun 11 16:44:43.712053 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:43.711959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pw9xx" event={"ID":"19f2fc50-546c-4a5f-9b9b-2e583e3923f7","Type":"ContainerDied","Data":"7cb9a16b2779148e4b5266b2aa290f587c82259ef8cfe268bafd88d9acb9dbbd"} Jun 11 16:44:44.124949 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:44.124761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:44.125121 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:44.124910 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:44:44.125121 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:44.125024 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls podName:99d2f1d8-f3f3-4c6f-97f0-c768caae1caf nodeName:}" failed. No retries permitted until 2026-06-11 16:44:46.125004473 +0000 UTC m=+39.103479992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls") pod "dns-default-qbhdp" (UID: "99d2f1d8-f3f3-4c6f-97f0-c768caae1caf") : secret "dns-default-metrics-tls" not found Jun 11 16:44:44.717974 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:44.717940 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pw9xx" event={"ID":"19f2fc50-546c-4a5f-9b9b-2e583e3923f7","Type":"ContainerStarted","Data":"bd0f53409bff3028baa9c3875faa49d55b894946fe6c2bcc11a014b7a0900fc2"} Jun 11 16:44:44.740796 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:44.740744 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pw9xx" podStartSLOduration=9.020613057 podStartE2EDuration="37.740731396s" totalImagesPullingTime="28.720118339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:44.739611453 +0000 UTC m=+37.718086983" watchObservedRunningTime="2026-06-11 16:44:44.740731396 +0000 UTC m=+37.719206924" Jun 11 16:44:44.862487 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:44.862421 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:44.964630 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:44.964604 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:45.722141 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:45.722097 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fd824" event={"ID":"49e31301-ebf6-493b-91e9-2525a50c4dd6","Type":"ContainerStarted","Data":"33fe94f508a6cfbebdead73a552ac541b0004777cfa76c9a89dde9633bab2989"} Jun 11 16:44:45.755688 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:45.755643 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fd824" podStartSLOduration=1.652146401 podStartE2EDuration="3.755626165s" totalImagesPullingTime="2.103479764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:45.754304001 +0000 UTC m=+38.732779529" watchObservedRunningTime="2026-06-11 16:44:45.755626165 +0000 UTC m=+38.734101693" Jun 11 16:44:46.140252 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:46.140222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:46.140412 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:46.140329 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:44:46.140412 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:46.140379 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls podName:99d2f1d8-f3f3-4c6f-97f0-c768caae1caf nodeName:}" failed. No retries permitted until 2026-06-11 16:44:50.140366023 +0000 UTC m=+43.118841529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls") pod "dns-default-qbhdp" (UID: "99d2f1d8-f3f3-4c6f-97f0-c768caae1caf") : secret "dns-default-metrics-tls" not found Jun 11 16:44:47.674780 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:47.674752 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:47.771533 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:47.771500 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:48.407247 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:48.407206 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:48.508464 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:48.508416 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:48.609879 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:48.609847 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:50.169630 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:50.169597 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:50.170006 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:50.169751 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:44:50.170006 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:50.169813 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls podName:99d2f1d8-f3f3-4c6f-97f0-c768caae1caf nodeName:}" failed. No retries permitted until 2026-06-11 16:44:58.16979814 +0000 UTC m=+51.148273646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls") pod "dns-default-qbhdp" (UID: "99d2f1d8-f3f3-4c6f-97f0-c768caae1caf") : secret "dns-default-metrics-tls" not found Jun 11 16:44:58.224950 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:44:58.224912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:44:58.225296 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:58.225067 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:44:58.225296 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:44:58.225132 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls podName:99d2f1d8-f3f3-4c6f-97f0-c768caae1caf nodeName:}" failed. No retries permitted until 2026-06-11 16:45:14.225116418 +0000 UTC m=+67.203591924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls") pod "dns-default-qbhdp" (UID: "99d2f1d8-f3f3-4c6f-97f0-c768caae1caf") : secret "dns-default-metrics-tls" not found Jun 11 16:45:04.452192 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.452157 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx"] Jun 11 16:45:04.457321 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.457304 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.461221 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.461186 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 16:45:04.461336 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.461224 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 16:45:04.461574 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.461558 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 16:45:04.461877 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.461854 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 16:45:04.461976 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.461887 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 16:45:04.461976 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.461932 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 16:45:04.462382 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.462367 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 16:45:04.472964 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.472944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-hub\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.473036 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.472977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.473036 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.473013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9fbd731-a096-43e7-8488-ce49cbd5cf48-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.473102 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.473036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-ca\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.473102 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.473056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hdkr\" (UniqueName: \"kubernetes.io/projected/d9fbd731-a096-43e7-8488-ce49cbd5cf48-kube-api-access-2hdkr\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.473102 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.473072 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.479288 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.479261 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx"] Jun 11 16:45:04.574045 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.574015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.574197 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.574062 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9fbd731-a096-43e7-8488-ce49cbd5cf48-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.574261 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.574242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-ca\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.574304 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.574278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hdkr\" (UniqueName: \"kubernetes.io/projected/d9fbd731-a096-43e7-8488-ce49cbd5cf48-kube-api-access-2hdkr\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.574304 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.574299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.574372 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.574344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-hub\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.574847 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.574816 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9fbd731-a096-43e7-8488-ce49cbd5cf48-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.577991 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.577967 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-ca\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.578076 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.578050 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-hub\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.578111 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.578052 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.578145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.578118 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9fbd731-a096-43e7-8488-ce49cbd5cf48-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.582153 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.582131 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hdkr\" (UniqueName: \"kubernetes.io/projected/d9fbd731-a096-43e7-8488-ce49cbd5cf48-kube-api-access-2hdkr\") pod \"cluster-proxy-proxy-agent-6db8fdc686-cfkzx\" (UID: \"d9fbd731-a096-43e7-8488-ce49cbd5cf48\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.774158 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.774074 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:45:04.908730 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:04.908335 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx"] Jun 11 16:45:04.912888 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:45:04.912860 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9fbd731_a096_43e7_8488_ce49cbd5cf48.slice/crio-dcfa7d949dac809e752074eaec60da9d83ea4718eb7f18b0ba548f9b546f7630 WatchSource:0}: Error finding container dcfa7d949dac809e752074eaec60da9d83ea4718eb7f18b0ba548f9b546f7630: Status 404 returned error can't find the container with id dcfa7d949dac809e752074eaec60da9d83ea4718eb7f18b0ba548f9b546f7630 Jun 11 16:45:05.766849 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:05.766810 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" event={"ID":"d9fbd731-a096-43e7-8488-ce49cbd5cf48","Type":"ContainerStarted","Data":"dcfa7d949dac809e752074eaec60da9d83ea4718eb7f18b0ba548f9b546f7630"} Jun 11 16:45:08.702031 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:08.702008 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd85h" Jun 11 16:45:08.776746 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:08.776713 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" event={"ID":"d9fbd731-a096-43e7-8488-ce49cbd5cf48","Type":"ContainerStarted","Data":"e74e5e05812d221e2e20a4514d59b2716af3b9c769f11e8cfb5cedffc84a6512"} Jun 11 16:45:09.781418 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:09.781383 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" event={"ID":"d9fbd731-a096-43e7-8488-ce49cbd5cf48","Type":"ContainerStarted","Data":"07a79c4dd45dcfd3dd9f54a8c5e7c336b432204e7bfc1f61069fdc249c4cb873"} Jun 11 16:45:09.781418 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:09.781426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" event={"ID":"d9fbd731-a096-43e7-8488-ce49cbd5cf48","Type":"ContainerStarted","Data":"961edebd9dba745cbc02d898a68ef2d7b189062c3bae475be4551cd0464da0b1"} Jun 11 16:45:09.805791 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:09.805741 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" podStartSLOduration=2.055862326 podStartE2EDuration="5.80572745s" totalImagesPullingTime="3.749865124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:09.804829563 +0000 UTC m=+62.783305103" watchObservedRunningTime="2026-06-11 16:45:09.80572745 +0000 UTC m=+62.784202979" Jun 11 16:45:13.236429 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.236386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:45:13.236820 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.236508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:45:13.239014 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.238994 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:45:13.239073 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.239040 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:45:13.246861 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:45:13.246847 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:45:13.246921 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:45:13.246902 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs podName:0682191c-9cec-4f46-a400-6053e8f3e033 nodeName:}" failed. No retries permitted until 2026-06-11 16:46:17.246884003 +0000 UTC m=+130.225359510 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs") pod "network-metrics-daemon-f226j" (UID: "0682191c-9cec-4f46-a400-6053e8f3e033") : secret "metrics-daemon-secret" not found Jun 11 16:45:13.249207 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.249178 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/822c473e-85e5-4340-8473-ad3f7f993dda-original-pull-secret\") pod \"global-pull-secret-syncer-k79r4\" (UID: \"822c473e-85e5-4340-8473-ad3f7f993dda\") " pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:45:13.435733 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.435698 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k79r4" Jun 11 16:45:13.437996 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.437973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9ss\" (UniqueName: \"kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss\") pod \"network-check-target-qgck5\" (UID: \"e318d141-fc7e-4509-9151-d606a86bb95d\") " pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:45:13.440435 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.440417 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:45:13.451960 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.451942 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:45:13.460946 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.460923 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k9ss\" (UniqueName: \"kubernetes.io/projected/e318d141-fc7e-4509-9151-d606a86bb95d-kube-api-access-6k9ss\") pod \"network-check-target-qgck5\" (UID: \"e318d141-fc7e-4509-9151-d606a86bb95d\") " pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:45:13.592559 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.592528 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k79r4"] Jun 11 16:45:13.596380 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:45:13.596345 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822c473e_85e5_4340_8473_ad3f7f993dda.slice/crio-00d73aca9096cf12f0ba25c21eb1df2a8788094bc7fefeaa327748f696d5bc75 WatchSource:0}: Error finding container 00d73aca9096cf12f0ba25c21eb1df2a8788094bc7fefeaa327748f696d5bc75: Status 404 returned error can't find the container with id 00d73aca9096cf12f0ba25c21eb1df2a8788094bc7fefeaa327748f696d5bc75 Jun 11 16:45:13.727702 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.727672 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mwddw\"" Jun 11 16:45:13.735258 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.735236 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:45:13.792508 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.792478 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k79r4" event={"ID":"822c473e-85e5-4340-8473-ad3f7f993dda","Type":"ContainerStarted","Data":"00d73aca9096cf12f0ba25c21eb1df2a8788094bc7fefeaa327748f696d5bc75"} Jun 11 16:45:13.893864 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:13.893832 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qgck5"] Jun 11 16:45:13.896790 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:45:13.896759 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode318d141_fc7e_4509_9151_d606a86bb95d.slice/crio-418095b1d1449a2e1422735a1aa91a0489205a58af793ea0e012c64ee19d0471 WatchSource:0}: Error finding container 418095b1d1449a2e1422735a1aa91a0489205a58af793ea0e012c64ee19d0471: Status 404 returned error can't find the container with id 418095b1d1449a2e1422735a1aa91a0489205a58af793ea0e012c64ee19d0471 Jun 11 16:45:14.244859 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:14.244817 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:45:14.245340 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:45:14.244993 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:45:14.245340 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:45:14.245073 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls podName:99d2f1d8-f3f3-4c6f-97f0-c768caae1caf nodeName:}" failed. No retries permitted until 2026-06-11 16:45:46.245054551 +0000 UTC m=+99.223530073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls") pod "dns-default-qbhdp" (UID: "99d2f1d8-f3f3-4c6f-97f0-c768caae1caf") : secret "dns-default-metrics-tls" not found Jun 11 16:45:14.797878 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:14.797803 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qgck5" event={"ID":"e318d141-fc7e-4509-9151-d606a86bb95d","Type":"ContainerStarted","Data":"418095b1d1449a2e1422735a1aa91a0489205a58af793ea0e012c64ee19d0471"} Jun 11 16:45:18.809851 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:18.809806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k79r4" event={"ID":"822c473e-85e5-4340-8473-ad3f7f993dda","Type":"ContainerStarted","Data":"939311e7048a51d35a6ad08f5b63e29b569fb58ee596702194aec01b25285bd5"} Jun 11 16:45:18.811224 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:18.811193 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qgck5" event={"ID":"e318d141-fc7e-4509-9151-d606a86bb95d","Type":"ContainerStarted","Data":"79a7d13595a7a32ccf5fab8a88e345d4dbc475f2f52eb8e66a4764daa4919a39"} Jun 11 16:45:18.811347 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:18.811315 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:45:18.824516 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:18.824474 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k79r4" podStartSLOduration=67.212896135 podStartE2EDuration="1m11.824444141s" totalImagesPullingTime="4.611548006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:18.823823917 +0000 UTC m=+71.802299446" watchObservedRunningTime="2026-06-11 16:45:18.824444141 +0000 UTC m=+71.802919667" Jun 11 16:45:18.837902 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:18.837838 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qgck5" podStartSLOduration=67.531756968 podStartE2EDuration="1m11.837825s" totalImagesPullingTime="4.306068032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:18.837593122 +0000 UTC m=+71.816068650" watchObservedRunningTime="2026-06-11 16:45:18.837825 +0000 UTC m=+71.816300529" Jun 11 16:45:46.261882 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:46.261823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:45:46.262508 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:45:46.261971 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:45:46.262508 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:45:46.262048 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls podName:99d2f1d8-f3f3-4c6f-97f0-c768caae1caf nodeName:}" failed. No retries permitted until 2026-06-11 16:46:50.262026791 +0000 UTC m=+163.240502301 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls") pod "dns-default-qbhdp" (UID: "99d2f1d8-f3f3-4c6f-97f0-c768caae1caf") : secret "dns-default-metrics-tls" not found Jun 11 16:45:49.816079 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:45:49.816052 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qgck5" Jun 11 16:46:17.267835 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:46:17.267780 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:46:17.268299 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:46:17.267934 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:46:17.268299 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:46:17.268015 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs podName:0682191c-9cec-4f46-a400-6053e8f3e033 nodeName:}" failed. No retries permitted until 2026-06-11 16:48:19.267998496 +0000 UTC m=+252.246474018 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs") pod "network-metrics-daemon-f226j" (UID: "0682191c-9cec-4f46-a400-6053e8f3e033") : secret "metrics-daemon-secret" not found Jun 11 16:46:45.377957 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:46:45.377913 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qbhdp" podUID="99d2f1d8-f3f3-4c6f-97f0-c768caae1caf" Jun 11 16:46:45.531016 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:46:45.530982 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:46:50.290685 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:46:50.290650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:46:50.291127 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:46:50.290750 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:46:50.291127 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:46:50.290798 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls podName:99d2f1d8-f3f3-4c6f-97f0-c768caae1caf nodeName:}" failed. No retries permitted until 2026-06-11 16:48:52.290786004 +0000 UTC m=+285.269261512 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls") pod "dns-default-qbhdp" (UID: "99d2f1d8-f3f3-4c6f-97f0-c768caae1caf") : secret "dns-default-metrics-tls" not found Jun 11 16:46:56.515836 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:46:56.515798 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qbhdp" Jun 11 16:47:00.516474 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:47:00.516405 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:48:19.298672 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:19.298577 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:48:19.299139 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:19.298714 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:48:19.299139 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:19.298797 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs podName:0682191c-9cec-4f46-a400-6053e8f3e033 nodeName:}" failed. No retries permitted until 2026-06-11 16:50:21.298775878 +0000 UTC m=+374.277251388 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs") pod "network-metrics-daemon-f226j" (UID: "0682191c-9cec-4f46-a400-6053e8f3e033") : secret "metrics-daemon-secret" not found Jun 11 16:48:30.794082 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.794047 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bb54b6d99-n4d6z"] Jun 11 16:48:30.797002 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.796981 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.799497 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.799479 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 16:48:30.800270 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.800186 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 16:48:30.800373 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.800225 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fsrsr\"" Jun 11 16:48:30.801398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.801381 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 16:48:30.809952 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.809931 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 16:48:30.822877 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.822858 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bb54b6d99-n4d6z"] Jun 11 16:48:30.877094 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.877056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99939da8-a4f0-44ed-8267-b52d2e31c95e-ca-trust-extracted\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.877259 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.877108 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-image-registry-private-configuration\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.877259 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.877216 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-certificates\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.877259 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.877240 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-bound-sa-token\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.877377 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.877262 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-trusted-ca\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.877377 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.877279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-installation-pull-secrets\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.877377 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.877298 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh96r\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-kube-api-access-dh96r\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.877377 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.877356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.978648 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.978612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-certificates\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.978648 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.978645 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-bound-sa-token\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.978903 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.978663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-trusted-ca\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.978903 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.978678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-installation-pull-secrets\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.978903 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.978696 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh96r\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-kube-api-access-dh96r\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.978903 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.978713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.978903 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.978750 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99939da8-a4f0-44ed-8267-b52d2e31c95e-ca-trust-extracted\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.978903 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.978788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-image-registry-private-configuration\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.978903 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:30.978833 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:48:30.978903 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:30.978855 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb54b6d99-n4d6z: secret "image-registry-tls" not found Jun 11 16:48:30.979269 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:30.978926 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls podName:99939da8-a4f0-44ed-8267-b52d2e31c95e nodeName:}" failed. No retries permitted until 2026-06-11 16:48:31.478903594 +0000 UTC m=+264.457379105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls") pod "image-registry-6bb54b6d99-n4d6z" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e") : secret "image-registry-tls" not found Jun 11 16:48:30.979370 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.979346 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99939da8-a4f0-44ed-8267-b52d2e31c95e-ca-trust-extracted\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.979433 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.979370 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-certificates\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.979708 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.979684 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-trusted-ca\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.981230 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.981209 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-image-registry-private-configuration\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.981312 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.981255 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-installation-pull-secrets\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.990054 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.990027 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-bound-sa-token\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:30.990220 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:30.990203 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh96r\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-kube-api-access-dh96r\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:31.483469 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:31.483420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:31.483641 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:31.483574 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:48:31.483641 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:31.483593 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb54b6d99-n4d6z: secret "image-registry-tls" not found Jun 11 16:48:31.483713 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:31.483655 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls podName:99939da8-a4f0-44ed-8267-b52d2e31c95e nodeName:}" failed. No retries permitted until 2026-06-11 16:48:32.483639078 +0000 UTC m=+265.462114585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls") pod "image-registry-6bb54b6d99-n4d6z" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e") : secret "image-registry-tls" not found Jun 11 16:48:32.490279 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:32.490238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:32.490698 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:32.490355 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:48:32.490698 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:32.490369 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb54b6d99-n4d6z: secret "image-registry-tls" not found Jun 11 16:48:32.490698 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:32.490418 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls podName:99939da8-a4f0-44ed-8267-b52d2e31c95e nodeName:}" failed. No retries permitted until 2026-06-11 16:48:34.490404508 +0000 UTC m=+267.468880014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls") pod "image-registry-6bb54b6d99-n4d6z" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e") : secret "image-registry-tls" not found Jun 11 16:48:34.505937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:34.505893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:34.506383 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:34.506037 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:48:34.506383 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:34.506061 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb54b6d99-n4d6z: secret "image-registry-tls" not found Jun 11 16:48:34.506383 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:34.506144 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls podName:99939da8-a4f0-44ed-8267-b52d2e31c95e nodeName:}" failed. No retries permitted until 2026-06-11 16:48:38.506122606 +0000 UTC m=+271.484598119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls") pod "image-registry-6bb54b6d99-n4d6z" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e") : secret "image-registry-tls" not found Jun 11 16:48:38.531961 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:38.531907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:38.532363 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:38.532056 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:48:38.532363 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:38.532079 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb54b6d99-n4d6z: secret "image-registry-tls" not found Jun 11 16:48:38.532363 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:48:38.532135 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls podName:99939da8-a4f0-44ed-8267-b52d2e31c95e nodeName:}" failed. No retries permitted until 2026-06-11 16:48:46.532119477 +0000 UTC m=+279.510594984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls") pod "image-registry-6bb54b6d99-n4d6z" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e") : secret "image-registry-tls" not found Jun 11 16:48:38.651571 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:38.651547 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tzg8h_090876e6-05f9-4e60-9e0c-a5dddc8571af/dns-node-resolver/0.log" Jun 11 16:48:39.650843 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:39.650816 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n45kd_b95027c8-1005-4bdf-b0cf-c095e8d14eb9/node-ca/0.log" Jun 11 16:48:40.051482 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:40.051397 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fd824_49e31301-ebf6-493b-91e9-2525a50c4dd6/serve-healthcheck-canary/0.log" Jun 11 16:48:46.587385 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:46.587349 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:46.589974 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:46.589951 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls\") pod \"image-registry-6bb54b6d99-n4d6z\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:46.706715 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:46.706685 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:46.847203 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:46.847135 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bb54b6d99-n4d6z"] Jun 11 16:48:46.850367 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:48:46.850341 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99939da8_a4f0_44ed_8267_b52d2e31c95e.slice/crio-f40f8f17500eaf7530f5770c2ab371cbe0e4a14efa920c30bc1708c0e84327c3 WatchSource:0}: Error finding container f40f8f17500eaf7530f5770c2ab371cbe0e4a14efa920c30bc1708c0e84327c3: Status 404 returned error can't find the container with id f40f8f17500eaf7530f5770c2ab371cbe0e4a14efa920c30bc1708c0e84327c3 Jun 11 16:48:47.383823 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:47.383793 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" event={"ID":"99939da8-a4f0-44ed-8267-b52d2e31c95e","Type":"ContainerStarted","Data":"4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722"} Jun 11 16:48:47.383989 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:47.383837 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" event={"ID":"99939da8-a4f0-44ed-8267-b52d2e31c95e","Type":"ContainerStarted","Data":"f40f8f17500eaf7530f5770c2ab371cbe0e4a14efa920c30bc1708c0e84327c3"} Jun 11 16:48:47.383989 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:47.383932 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:48:47.407810 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:47.407763 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" podStartSLOduration=17.407746216 podStartE2EDuration="17.407746216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:47.40626472 +0000 UTC m=+280.384740249" watchObservedRunningTime="2026-06-11 16:48:47.407746216 +0000 UTC m=+280.386221745" Jun 11 16:48:52.328827 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:52.328784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:48:52.331159 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:52.331133 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d2f1d8-f3f3-4c6f-97f0-c768caae1caf-metrics-tls\") pod \"dns-default-qbhdp\" (UID: \"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf\") " pod="openshift-dns/dns-default-qbhdp" Jun 11 16:48:52.619669 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:52.619644 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d9x4d\"" Jun 11 16:48:52.627676 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:52.627641 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qbhdp" Jun 11 16:48:52.751483 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:52.751438 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qbhdp"] Jun 11 16:48:52.754515 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:48:52.754486 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d2f1d8_f3f3_4c6f_97f0_c768caae1caf.slice/crio-22f43ac7ccaa22125d8877a4c108353ec9a4064c385c98f94edb86d768e762b9 WatchSource:0}: Error finding container 22f43ac7ccaa22125d8877a4c108353ec9a4064c385c98f94edb86d768e762b9: Status 404 returned error can't find the container with id 22f43ac7ccaa22125d8877a4c108353ec9a4064c385c98f94edb86d768e762b9 Jun 11 16:48:53.402792 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:53.402748 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qbhdp" event={"ID":"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf","Type":"ContainerStarted","Data":"22f43ac7ccaa22125d8877a4c108353ec9a4064c385c98f94edb86d768e762b9"} Jun 11 16:48:54.408549 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:54.408518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qbhdp" event={"ID":"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf","Type":"ContainerStarted","Data":"15d50695081880de306e76a26ca26382835e963799da8b180dc44e4152b8d7d1"} Jun 11 16:48:54.409074 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:54.408575 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qbhdp" event={"ID":"99d2f1d8-f3f3-4c6f-97f0-c768caae1caf","Type":"ContainerStarted","Data":"8b133d361819fe5dafc6e6ca30957728412b7f28d726c665fe1192b43482dde3"} Jun 11 16:48:54.409074 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:54.408647 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qbhdp" Jun 11 16:48:54.428200 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:48:54.428138 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qbhdp" podStartSLOduration=251.001084102 podStartE2EDuration="4m12.428120788s" totalImagesPullingTime="1.427036686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:54.427812793 +0000 UTC m=+287.406288322" watchObservedRunningTime="2026-06-11 16:48:54.428120788 +0000 UTC m=+287.406596317" Jun 11 16:49:01.860528 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.860495 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f96sw"] Jun 11 16:49:01.863614 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.863597 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:01.867691 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.867665 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:49:01.867805 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.867676 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4vcj6\"" Jun 11 16:49:01.867866 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.867820 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:49:01.867866 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.867846 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:49:01.868094 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.868078 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:49:01.886184 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.886159 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f96sw"] Jun 11 16:49:01.886907 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.886892 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bb54b6d99-n4d6z"] Jun 11 16:49:01.893347 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.893319 2580 patch_prober.go:28] interesting pod/image-registry-6bb54b6d99-n4d6z container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:49:01.893484 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.893371 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" podUID="99939da8-a4f0-44ed-8267-b52d2e31c95e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:49:01.935789 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.935754 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v"] Jun 11 16:49:01.938540 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.938524 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v" Jun 11 16:49:01.941750 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.941730 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 16:49:01.941938 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.941925 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-r2dr2\"" Jun 11 16:49:01.967895 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.967871 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v"] Jun 11 16:49:01.994075 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.994046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb802322-ddff-433f-a837-692cf97d8908-crio-socket\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:01.994205 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.994081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb802322-ddff-433f-a837-692cf97d8908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:01.994205 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.994101 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb802322-ddff-433f-a837-692cf97d8908-data-volume\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:01.994205 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.994137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb802322-ddff-433f-a837-692cf97d8908-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:01.994310 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:01.994203 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-772pg\" (UniqueName: \"kubernetes.io/projected/cb802322-ddff-433f-a837-692cf97d8908-kube-api-access-772pg\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.095170 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.095133 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4b9e705-e2f6-451a-89f9-5269541c5cb6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-trs9v\" (UID: \"c4b9e705-e2f6-451a-89f9-5269541c5cb6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v" Jun 11 16:49:02.095340 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.095182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb802322-ddff-433f-a837-692cf97d8908-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.095340 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.095243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-772pg\" (UniqueName: \"kubernetes.io/projected/cb802322-ddff-433f-a837-692cf97d8908-kube-api-access-772pg\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.095340 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.095290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb802322-ddff-433f-a837-692cf97d8908-crio-socket\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.095340 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.095319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb802322-ddff-433f-a837-692cf97d8908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.095574 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.095340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb802322-ddff-433f-a837-692cf97d8908-data-volume\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.095574 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.095416 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb802322-ddff-433f-a837-692cf97d8908-crio-socket\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.095693 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.095677 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb802322-ddff-433f-a837-692cf97d8908-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.095729 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.095682 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb802322-ddff-433f-a837-692cf97d8908-data-volume\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.097720 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.097704 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb802322-ddff-433f-a837-692cf97d8908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.109092 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.109063 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-772pg\" (UniqueName: \"kubernetes.io/projected/cb802322-ddff-433f-a837-692cf97d8908-kube-api-access-772pg\") pod \"insights-runtime-extractor-f96sw\" (UID: \"cb802322-ddff-433f-a837-692cf97d8908\") " pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.172200 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.172109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f96sw" Jun 11 16:49:02.196439 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.196408 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4b9e705-e2f6-451a-89f9-5269541c5cb6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-trs9v\" (UID: \"c4b9e705-e2f6-451a-89f9-5269541c5cb6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v" Jun 11 16:49:02.198926 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.198896 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4b9e705-e2f6-451a-89f9-5269541c5cb6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-trs9v\" (UID: \"c4b9e705-e2f6-451a-89f9-5269541c5cb6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v" Jun 11 16:49:02.246972 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.246943 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v" Jun 11 16:49:02.309070 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.309034 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f96sw"] Jun 11 16:49:02.313295 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:49:02.313272 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb802322_ddff_433f_a837_692cf97d8908.slice/crio-d62b5eefba720220cec621b95f60eee44c237325ddc1493b5ef7a48baffcebee WatchSource:0}: Error finding container d62b5eefba720220cec621b95f60eee44c237325ddc1493b5ef7a48baffcebee: Status 404 returned error can't find the container with id d62b5eefba720220cec621b95f60eee44c237325ddc1493b5ef7a48baffcebee Jun 11 16:49:02.386069 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.386043 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v"] Jun 11 16:49:02.390300 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:49:02.390273 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b9e705_e2f6_451a_89f9_5269541c5cb6.slice/crio-ecef38977ba5358d18ebd929b3f74a8d253d932aaca60b9d0d571b44ea56fd37 WatchSource:0}: Error finding container ecef38977ba5358d18ebd929b3f74a8d253d932aaca60b9d0d571b44ea56fd37: Status 404 returned error can't find the container with id ecef38977ba5358d18ebd929b3f74a8d253d932aaca60b9d0d571b44ea56fd37 Jun 11 16:49:02.432933 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.432872 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v" event={"ID":"c4b9e705-e2f6-451a-89f9-5269541c5cb6","Type":"ContainerStarted","Data":"ecef38977ba5358d18ebd929b3f74a8d253d932aaca60b9d0d571b44ea56fd37"} Jun 11 16:49:02.434223 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.434198 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f96sw" event={"ID":"cb802322-ddff-433f-a837-692cf97d8908","Type":"ContainerStarted","Data":"9f535c042986760dc397a87ee41a5d3ea2c9df9cdba5bba506df7924ab8b3ac7"} Jun 11 16:49:02.434311 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:02.434245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f96sw" event={"ID":"cb802322-ddff-433f-a837-692cf97d8908","Type":"ContainerStarted","Data":"d62b5eefba720220cec621b95f60eee44c237325ddc1493b5ef7a48baffcebee"} Jun 11 16:49:03.439707 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:03.439679 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f96sw" event={"ID":"cb802322-ddff-433f-a837-692cf97d8908","Type":"ContainerStarted","Data":"c8ae608147f2da6b10ba451a12b1d48a72cf7bdd2896f5625bba761a6d750aa8"} Jun 11 16:49:03.517472 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:49:03.517417 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f226j" podUID="0682191c-9cec-4f46-a400-6053e8f3e033" Jun 11 16:49:04.414264 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:04.414231 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qbhdp" Jun 11 16:49:04.445442 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:04.445403 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v" event={"ID":"c4b9e705-e2f6-451a-89f9-5269541c5cb6","Type":"ContainerStarted","Data":"1a88f59e4043c8d15c4d119cf22c06a0b1a12d6f246d09b92c4ca07410e68e36"} Jun 11 16:49:04.445810 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:04.445648 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v" Jun 11 16:49:04.451131 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:04.451108 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v" Jun 11 16:49:04.464577 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:04.464536 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-trs9v" podStartSLOduration=2.454094883 podStartE2EDuration="3.464523352s" totalImagesPullingTime="1.010428469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:04.46404735 +0000 UTC m=+297.442522884" watchObservedRunningTime="2026-06-11 16:49:04.464523352 +0000 UTC m=+297.442998858" Jun 11 16:49:05.450262 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:05.450225 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f96sw" event={"ID":"cb802322-ddff-433f-a837-692cf97d8908","Type":"ContainerStarted","Data":"e48b3b19363a0182dc6e85f82afcfff67349eecae6a6608deb110525d540b182"} Jun 11 16:49:05.471067 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:05.471025 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f96sw" podStartSLOduration=2.477320092 podStartE2EDuration="4.471009036s" totalImagesPullingTime="1.993688944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:49:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:05.469722094 +0000 UTC m=+298.448197623" watchObservedRunningTime="2026-06-11 16:49:05.471009036 +0000 UTC m=+298.449484605" Jun 11 16:49:07.455464 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:07.455420 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 16:49:07.455953 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:07.455657 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 16:49:07.462526 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:07.462504 2580 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:49:10.270020 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.269988 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59"] Jun 11 16:49:10.273374 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.273359 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.275780 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.275760 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:49:10.275906 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.275870 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:49:10.275906 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.275870 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 16:49:10.276028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.275901 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 16:49:10.276028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.275989 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nmbwk\"" Jun 11 16:49:10.276582 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.276569 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:49:10.283480 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.283437 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59"] Jun 11 16:49:10.308277 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.308258 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw"] Jun 11 16:49:10.311239 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.311226 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.313974 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.313956 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 16:49:10.313974 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.313946 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 16:49:10.314138 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.314049 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 16:49:10.314213 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.314193 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jpbcp\"" Jun 11 16:49:10.329078 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.329059 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw"] Jun 11 16:49:10.334306 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.334287 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h2fcp"] Jun 11 16:49:10.337287 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.337273 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.343601 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.343578 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:49:10.343708 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.343629 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nvhnv\"" Jun 11 16:49:10.343708 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.343651 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:49:10.343708 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.343590 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:49:10.360854 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.360834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-root\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.360928 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.360860 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-metrics-client-ca\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.360928 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.360877 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.360928 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.360895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.361020 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.360946 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.361020 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.360988 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8glmj\" (UniqueName: \"kubernetes.io/projected/484281b1-4bc3-42a4-b983-68d1dba96973-kube-api-access-8glmj\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.361020 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78q9k\" (UniqueName: \"kubernetes.io/projected/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-api-access-78q9k\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.361110 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/484281b1-4bc3-42a4-b983-68d1dba96973-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.361110 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/484281b1-4bc3-42a4-b983-68d1dba96973-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.361110 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-tls\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.361110 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fkf9\" (UniqueName: \"kubernetes.io/projected/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-kube-api-access-4fkf9\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.361224 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361110 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-wtmp\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.361224 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.361224 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361166 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e9fb72e8-f289-4a65-8827-3929f0fd4568-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.361224 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9fb72e8-f289-4a65-8827-3929f0fd4568-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.361224 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-sys\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.361367 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-textfile\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.361367 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361253 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/484281b1-4bc3-42a4-b983-68d1dba96973-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.361367 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.361282 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.462415 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-root\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.462600 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-metrics-client-ca\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.462600 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.462600 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.462600 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462502 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.462600 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462511 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-root\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.462600 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:49:10.462585 2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 16:49:10.462907 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8glmj\" (UniqueName: \"kubernetes.io/projected/484281b1-4bc3-42a4-b983-68d1dba96973-kube-api-access-8glmj\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.462907 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:49:10.462646 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-tls podName:e9fb72e8-f289-4a65-8827-3929f0fd4568 nodeName:}" failed. No retries permitted until 2026-06-11 16:49:10.962630394 +0000 UTC m=+303.941105905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-f47lw" (UID: "e9fb72e8-f289-4a65-8827-3929f0fd4568") : secret "kube-state-metrics-tls" not found Jun 11 16:49:10.462907 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78q9k\" (UniqueName: \"kubernetes.io/projected/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-api-access-78q9k\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.462907 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/484281b1-4bc3-42a4-b983-68d1dba96973-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.462907 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/484281b1-4bc3-42a4-b983-68d1dba96973-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.462907 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-tls\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.462907 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fkf9\" (UniqueName: \"kubernetes.io/projected/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-kube-api-access-4fkf9\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.462907 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:49:10.462850 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:49:10.462916 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/484281b1-4bc3-42a4-b983-68d1dba96973-openshift-state-metrics-tls podName:484281b1-4bc3-42a4-b983-68d1dba96973 nodeName:}" failed. No retries permitted until 2026-06-11 16:49:10.9628998 +0000 UTC m=+303.941375308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/484281b1-4bc3-42a4-b983-68d1dba96973-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-hlp59" (UID: "484281b1-4bc3-42a4-b983-68d1dba96973") : secret "openshift-state-metrics-tls" not found Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-wtmp\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.462982 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-wtmp\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e9fb72e8-f289-4a65-8827-3929f0fd4568-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9fb72e8-f289-4a65-8827-3929f0fd4568-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463083 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-sys\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-textfile\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/484281b1-4bc3-42a4-b983-68d1dba96973-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463164 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463204 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-sys\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463236 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.463280 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463244 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-metrics-client-ca\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.464129 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463530 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-textfile\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.464129 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463536 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e9fb72e8-f289-4a65-8827-3929f0fd4568-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.464129 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463703 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.464129 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463745 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/484281b1-4bc3-42a4-b983-68d1dba96973-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.464129 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.463866 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9fb72e8-f289-4a65-8827-3929f0fd4568-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.465812 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.465761 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.465945 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.465902 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-tls\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.466174 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.466151 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/484281b1-4bc3-42a4-b983-68d1dba96973-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.466221 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.466178 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.470737 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.470713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fkf9\" (UniqueName: \"kubernetes.io/projected/b97f2442-6b31-48ed-9c58-2e3e39f2f7bf-kube-api-access-4fkf9\") pod \"node-exporter-h2fcp\" (UID: \"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf\") " pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.470737 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.470729 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8glmj\" (UniqueName: \"kubernetes.io/projected/484281b1-4bc3-42a4-b983-68d1dba96973-kube-api-access-8glmj\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.471029 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.471011 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78q9k\" (UniqueName: \"kubernetes.io/projected/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-api-access-78q9k\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.645111 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.645084 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h2fcp" Jun 11 16:49:10.656675 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:49:10.656642 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97f2442_6b31_48ed_9c58_2e3e39f2f7bf.slice/crio-7b1f21a7c74346b81a1ac494c65ac2540d006b6781751dc72d9c1ea209283164 WatchSource:0}: Error finding container 7b1f21a7c74346b81a1ac494c65ac2540d006b6781751dc72d9c1ea209283164: Status 404 returned error can't find the container with id 7b1f21a7c74346b81a1ac494c65ac2540d006b6781751dc72d9c1ea209283164 Jun 11 16:49:10.658630 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.658612 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:49:10.912747 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.912668 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d8f46fbc5-qst8n"] Jun 11 16:49:10.916592 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.916569 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:10.923264 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.923243 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 16:49:10.923644 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.923624 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 16:49:10.923783 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.923762 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fvk45\"" Jun 11 16:49:10.923865 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.923773 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 16:49:10.923962 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.923949 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 16:49:10.924028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.924014 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 16:49:10.924521 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.924507 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 16:49:10.924577 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.924530 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 16:49:10.929706 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.929687 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 16:49:10.939541 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.939516 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d8f46fbc5-qst8n"] Jun 11 16:49:10.966386 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.966354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/484281b1-4bc3-42a4-b983-68d1dba96973-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.966549 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.966396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zllq\" (UniqueName: \"kubernetes.io/projected/457d019b-4dc8-4155-a622-72fc243f3523-kube-api-access-5zllq\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:10.966549 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.966510 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-serving-cert\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:10.966549 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.966541 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-service-ca\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:10.966716 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.966604 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-trusted-ca-bundle\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:10.966716 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.966669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-console-config\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:10.966801 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.966744 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-oauth-config\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:10.966838 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.966806 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:10.966874 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.966860 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-oauth-serving-cert\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:10.969013 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.968995 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/484281b1-4bc3-42a4-b983-68d1dba96973-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hlp59\" (UID: \"484281b1-4bc3-42a4-b983-68d1dba96973\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:10.969381 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:10.969363 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fb72e8-f289-4a65-8827-3929f0fd4568-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-f47lw\" (UID: \"e9fb72e8-f289-4a65-8827-3929f0fd4568\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:11.067741 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.067690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-oauth-serving-cert\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.067928 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.067748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zllq\" (UniqueName: \"kubernetes.io/projected/457d019b-4dc8-4155-a622-72fc243f3523-kube-api-access-5zllq\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.067928 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.067795 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-serving-cert\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.067928 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.067820 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-service-ca\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.067928 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.067851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-trusted-ca-bundle\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.067928 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.067895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-console-config\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.067928 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.067922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-oauth-config\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.068568 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.068504 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-oauth-serving-cert\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.069114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.069092 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-trusted-ca-bundle\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.069201 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.069152 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-console-config\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.069310 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.069290 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-service-ca\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.071076 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.071050 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-oauth-config\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.071364 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.071342 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-serving-cert\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.077960 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.077937 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zllq\" (UniqueName: \"kubernetes.io/projected/457d019b-4dc8-4155-a622-72fc243f3523-kube-api-access-5zllq\") pod \"console-d8f46fbc5-qst8n\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.182651 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.182576 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" Jun 11 16:49:11.219373 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.219342 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" Jun 11 16:49:11.225620 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.225594 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:11.473617 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.473569 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2fcp" event={"ID":"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf","Type":"ContainerStarted","Data":"7b1f21a7c74346b81a1ac494c65ac2540d006b6781751dc72d9c1ea209283164"} Jun 11 16:49:11.566207 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.566179 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59"] Jun 11 16:49:11.569146 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:49:11.569118 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484281b1_4bc3_42a4_b983_68d1dba96973.slice/crio-6e4c378ac16e4edbf7ce17a2e506822356afeb29794add86b5d7810005521297 WatchSource:0}: Error finding container 6e4c378ac16e4edbf7ce17a2e506822356afeb29794add86b5d7810005521297: Status 404 returned error can't find the container with id 6e4c378ac16e4edbf7ce17a2e506822356afeb29794add86b5d7810005521297 Jun 11 16:49:11.589156 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.589119 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw"] Jun 11 16:49:11.592636 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.592613 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d8f46fbc5-qst8n"] Jun 11 16:49:11.597738 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:49:11.597698 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457d019b_4dc8_4155_a622_72fc243f3523.slice/crio-fc26d1273bbf1ccc58229511eeba93e0acea931d2a469ece67d3782383d15dc6 WatchSource:0}: Error finding container fc26d1273bbf1ccc58229511eeba93e0acea931d2a469ece67d3782383d15dc6: Status 404 returned error can't find the container with id fc26d1273bbf1ccc58229511eeba93e0acea931d2a469ece67d3782383d15dc6 Jun 11 16:49:11.598186 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:49:11.598164 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9fb72e8_f289_4a65_8827_3929f0fd4568.slice/crio-e21e3b7bf0ee83cb8c965b1366d29c29fe070645d02941cabbb9c0785adfc8be WatchSource:0}: Error finding container e21e3b7bf0ee83cb8c965b1366d29c29fe070645d02941cabbb9c0785adfc8be: Status 404 returned error can't find the container with id e21e3b7bf0ee83cb8c965b1366d29c29fe070645d02941cabbb9c0785adfc8be Jun 11 16:49:11.891406 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:11.891380 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:49:12.479883 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:12.479818 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2fcp" event={"ID":"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf","Type":"ContainerDied","Data":"6981985cef8aac405e66a9148db0cfe6484301b586b03afd9787b51a9edfac1d"} Jun 11 16:49:12.480270 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:12.480122 2580 generic.go:356] "Generic (PLEG): container finished" podID="b97f2442-6b31-48ed-9c58-2e3e39f2f7bf" containerID="6981985cef8aac405e66a9148db0cfe6484301b586b03afd9787b51a9edfac1d" exitCode=0 Jun 11 16:49:12.482421 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:12.482396 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" event={"ID":"e9fb72e8-f289-4a65-8827-3929f0fd4568","Type":"ContainerStarted","Data":"e21e3b7bf0ee83cb8c965b1366d29c29fe070645d02941cabbb9c0785adfc8be"} Jun 11 16:49:12.484992 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:12.484959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" event={"ID":"484281b1-4bc3-42a4-b983-68d1dba96973","Type":"ContainerStarted","Data":"e4ddb4f9ead296f9676ec28602ed85ae7086059115afed42af0a5a84f3b5e322"} Jun 11 16:49:12.485089 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:12.485020 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" event={"ID":"484281b1-4bc3-42a4-b983-68d1dba96973","Type":"ContainerStarted","Data":"1c9f7a691e2d82bfdea28c09dab62e9ca15d7d984c441cfe5f6fa9f219b2eb85"} Jun 11 16:49:12.485089 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:12.485050 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" event={"ID":"484281b1-4bc3-42a4-b983-68d1dba96973","Type":"ContainerStarted","Data":"6e4c378ac16e4edbf7ce17a2e506822356afeb29794add86b5d7810005521297"} Jun 11 16:49:12.486402 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:12.486378 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8f46fbc5-qst8n" event={"ID":"457d019b-4dc8-4155-a622-72fc243f3523","Type":"ContainerStarted","Data":"fc26d1273bbf1ccc58229511eeba93e0acea931d2a469ece67d3782383d15dc6"} Jun 11 16:49:13.293426 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.293387 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j"] Jun 11 16:49:13.297520 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.297495 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.300066 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.300038 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 16:49:13.300291 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.300204 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 16:49:13.300291 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.300258 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 16:49:13.300631 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.300601 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bpnpb77s2rg21\"" Jun 11 16:49:13.300711 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.300675 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cvpsv\"" Jun 11 16:49:13.300792 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.300765 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 16:49:13.300883 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.300868 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 16:49:13.311282 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.311260 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j"] Jun 11 16:49:13.386926 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.386899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-tls\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.387032 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.386936 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmtqs\" (UniqueName: \"kubernetes.io/projected/b582517d-b88e-4a6d-8d31-65d1bba712ac-kube-api-access-pmtqs\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.387032 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.386965 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.387142 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.387033 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.387197 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.387136 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b582517d-b88e-4a6d-8d31-65d1bba712ac-metrics-client-ca\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.387197 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.387183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-grpc-tls\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.387294 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.387233 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.387294 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.387276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.488797 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.488313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-tls\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.488797 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.488356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmtqs\" (UniqueName: \"kubernetes.io/projected/b582517d-b88e-4a6d-8d31-65d1bba712ac-kube-api-access-pmtqs\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.488797 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.488382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.488797 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.488410 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.489382 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.488833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b582517d-b88e-4a6d-8d31-65d1bba712ac-metrics-client-ca\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.489382 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.488905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-grpc-tls\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.489382 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.488958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.489382 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.489000 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.489847 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.489822 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b582517d-b88e-4a6d-8d31-65d1bba712ac-metrics-client-ca\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.491824 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.491764 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.492327 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.492274 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-grpc-tls\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.492802 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.492771 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-tls\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.493125 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.493103 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.493539 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.493519 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.493920 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.493900 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b582517d-b88e-4a6d-8d31-65d1bba712ac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.495021 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.494399 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" event={"ID":"e9fb72e8-f289-4a65-8827-3929f0fd4568","Type":"ContainerStarted","Data":"03a3d26a294cce3273593075adbe5a1dfe60bfe637cd2ddd6186d8ccb5356506"} Jun 11 16:49:13.495021 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.494487 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" event={"ID":"e9fb72e8-f289-4a65-8827-3929f0fd4568","Type":"ContainerStarted","Data":"996e92f30b7e592a0cef5f339e48f3cd73cf7da71d539bf4b069090b52784a00"} Jun 11 16:49:13.495021 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.494521 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" event={"ID":"e9fb72e8-f289-4a65-8827-3929f0fd4568","Type":"ContainerStarted","Data":"997e0c53c5ccde42c7a1ccf33b2e442e4833e8a3ea9f61e848c071cbd363ba41"} Jun 11 16:49:13.497468 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.497419 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" event={"ID":"484281b1-4bc3-42a4-b983-68d1dba96973","Type":"ContainerStarted","Data":"acbc9f40778526d5f6790edae7a4726b38d9459b055b45413fa0c4d38b4cfbb7"} Jun 11 16:49:13.498130 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.498108 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmtqs\" (UniqueName: \"kubernetes.io/projected/b582517d-b88e-4a6d-8d31-65d1bba712ac-kube-api-access-pmtqs\") pod \"thanos-querier-7fcd8c8f5f-8fr9j\" (UID: \"b582517d-b88e-4a6d-8d31-65d1bba712ac\") " pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.499963 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.499936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2fcp" event={"ID":"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf","Type":"ContainerStarted","Data":"9f230faebe27e3c6b3ace45b874d1cd689391149c990a44976a1385740fe023f"} Jun 11 16:49:13.500043 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.499982 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2fcp" event={"ID":"b97f2442-6b31-48ed-9c58-2e3e39f2f7bf","Type":"ContainerStarted","Data":"5dd5e0404c0feb6576f0be4032f154bcfc4a2ee26164aa1f3234c82622cd64d7"} Jun 11 16:49:13.513793 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.513554 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-f47lw" podStartSLOduration=2.246839618 podStartE2EDuration="3.513537818s" totalImagesPullingTime="1.2666982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:13.513156137 +0000 UTC m=+306.491631668" watchObservedRunningTime="2026-06-11 16:49:13.513537818 +0000 UTC m=+306.492013338" Jun 11 16:49:13.531313 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.531278 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h2fcp" podStartSLOduration=2.65655001 podStartE2EDuration="3.531265241s" totalImagesPullingTime="797.66761ms" totalInitContainerRuntime="77.047621ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:13.531050927 +0000 UTC m=+306.509526455" watchObservedRunningTime="2026-06-11 16:49:13.531265241 +0000 UTC m=+306.509740770" Jun 11 16:49:13.550884 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.550808 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hlp59" podStartSLOduration=1.9177018810000002 podStartE2EDuration="3.550795042s" totalImagesPullingTime="1.633093161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:13.550169307 +0000 UTC m=+306.528644836" watchObservedRunningTime="2026-06-11 16:49:13.550795042 +0000 UTC m=+306.529270585" Jun 11 16:49:13.607587 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.607554 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:13.764153 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:13.764115 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j"] Jun 11 16:49:14.721515 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:49:14.721438 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb582517d_b88e_4a6d_8d31_65d1bba712ac.slice/crio-810487dba65f4e3682dc76498b90ef1517a4f05f74f7acbb6274a3b5aedcdd89 WatchSource:0}: Error finding container 810487dba65f4e3682dc76498b90ef1517a4f05f74f7acbb6274a3b5aedcdd89: Status 404 returned error can't find the container with id 810487dba65f4e3682dc76498b90ef1517a4f05f74f7acbb6274a3b5aedcdd89 Jun 11 16:49:15.509509 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:15.509470 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" event={"ID":"b582517d-b88e-4a6d-8d31-65d1bba712ac","Type":"ContainerStarted","Data":"810487dba65f4e3682dc76498b90ef1517a4f05f74f7acbb6274a3b5aedcdd89"} Jun 11 16:49:15.511054 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:15.511025 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8f46fbc5-qst8n" event={"ID":"457d019b-4dc8-4155-a622-72fc243f3523","Type":"ContainerStarted","Data":"d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483"} Jun 11 16:49:15.545212 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:15.545163 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d8f46fbc5-qst8n" podStartSLOduration=2.374492749 podStartE2EDuration="5.545149503s" totalImagesPullingTime="3.170656754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:15.54433624 +0000 UTC m=+308.522811769" watchObservedRunningTime="2026-06-11 16:49:15.545149503 +0000 UTC m=+308.523625032" Jun 11 16:49:16.362628 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:16.362590 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d8f46fbc5-qst8n"] Jun 11 16:49:17.521648 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:17.521614 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" event={"ID":"b582517d-b88e-4a6d-8d31-65d1bba712ac","Type":"ContainerStarted","Data":"57b77b05a6cf713002032dfeff397ec648a110979117eb52cc991260013ca5e0"} Jun 11 16:49:17.522048 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:17.521684 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" event={"ID":"b582517d-b88e-4a6d-8d31-65d1bba712ac","Type":"ContainerStarted","Data":"6f64251a41e1070f7649639e96b94cd25ae39cd9f4e787246bbc3f70401e2b6c"} Jun 11 16:49:17.522048 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:17.521719 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" event={"ID":"b582517d-b88e-4a6d-8d31-65d1bba712ac","Type":"ContainerStarted","Data":"a8651e2853c0c428a85aa4fa6117da208f922182f29463c3a54f97c6f4fa49e7"} Jun 11 16:49:18.515613 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:18.515576 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:49:18.527902 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:18.527864 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" event={"ID":"b582517d-b88e-4a6d-8d31-65d1bba712ac","Type":"ContainerStarted","Data":"f552612a072eb1c9a490f6781a9d2df9aa498ed8533abb2ed40851459a59e4c1"} Jun 11 16:49:18.528275 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:18.527932 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" event={"ID":"b582517d-b88e-4a6d-8d31-65d1bba712ac","Type":"ContainerStarted","Data":"42ff66fae48e2cfc29e1da2a35be3ce60b5191ca033e38de6e646d339027a662"} Jun 11 16:49:18.528275 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:18.527968 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" event={"ID":"b582517d-b88e-4a6d-8d31-65d1bba712ac","Type":"ContainerStarted","Data":"dadbb149b6a8861184d1dc3e24d929c82b05533f5d68775d3ac3558fe9df3533"} Jun 11 16:49:18.528275 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:18.528041 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:18.555613 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:18.555565 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" podStartSLOduration=2.682126146 podStartE2EDuration="5.555552025s" totalImagesPullingTime="2.873425879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:18.554531302 +0000 UTC m=+311.533006831" watchObservedRunningTime="2026-06-11 16:49:18.555552025 +0000 UTC m=+311.534027602" Jun 11 16:49:21.226610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:21.226580 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:24.537800 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:24.537771 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7fcd8c8f5f-8fr9j" Jun 11 16:49:26.907906 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:26.907860 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" podUID="99939da8-a4f0-44ed-8267-b52d2e31c95e" containerName="registry" containerID="cri-o://4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722" gracePeriod=30 Jun 11 16:49:27.153618 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.153591 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:49:27.195063 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.194989 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh96r\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-kube-api-access-dh96r\") pod \"99939da8-a4f0-44ed-8267-b52d2e31c95e\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " Jun 11 16:49:27.195063 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.195025 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99939da8-a4f0-44ed-8267-b52d2e31c95e-ca-trust-extracted\") pod \"99939da8-a4f0-44ed-8267-b52d2e31c95e\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " Jun 11 16:49:27.195244 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.195071 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-installation-pull-secrets\") pod \"99939da8-a4f0-44ed-8267-b52d2e31c95e\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " Jun 11 16:49:27.195244 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.195091 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-certificates\") pod \"99939da8-a4f0-44ed-8267-b52d2e31c95e\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " Jun 11 16:49:27.195244 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.195141 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls\") pod \"99939da8-a4f0-44ed-8267-b52d2e31c95e\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " Jun 11 16:49:27.195416 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.195291 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-image-registry-private-configuration\") pod \"99939da8-a4f0-44ed-8267-b52d2e31c95e\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " Jun 11 16:49:27.195416 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.195356 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-bound-sa-token\") pod \"99939da8-a4f0-44ed-8267-b52d2e31c95e\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " Jun 11 16:49:27.195416 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.195395 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-trusted-ca\") pod \"99939da8-a4f0-44ed-8267-b52d2e31c95e\" (UID: \"99939da8-a4f0-44ed-8267-b52d2e31c95e\") " Jun 11 16:49:27.195589 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.195569 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "99939da8-a4f0-44ed-8267-b52d2e31c95e" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:49:27.195903 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.195712 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-certificates\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:27.195988 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.195960 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "99939da8-a4f0-44ed-8267-b52d2e31c95e" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:49:27.197706 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.197679 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-kube-api-access-dh96r" (OuterVolumeSpecName: "kube-api-access-dh96r") pod "99939da8-a4f0-44ed-8267-b52d2e31c95e" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e"). InnerVolumeSpecName "kube-api-access-dh96r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:49:27.197706 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.197695 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "99939da8-a4f0-44ed-8267-b52d2e31c95e" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:49:27.197856 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.197813 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "99939da8-a4f0-44ed-8267-b52d2e31c95e" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:49:27.197856 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.197842 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "99939da8-a4f0-44ed-8267-b52d2e31c95e" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:49:27.198115 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.198092 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "99939da8-a4f0-44ed-8267-b52d2e31c95e" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:49:27.205244 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.205222 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99939da8-a4f0-44ed-8267-b52d2e31c95e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "99939da8-a4f0-44ed-8267-b52d2e31c95e" (UID: "99939da8-a4f0-44ed-8267-b52d2e31c95e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:49:27.296848 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.296818 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh96r\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-kube-api-access-dh96r\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:27.296848 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.296842 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99939da8-a4f0-44ed-8267-b52d2e31c95e-ca-trust-extracted\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:27.296848 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.296852 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-installation-pull-secrets\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:27.297019 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.296861 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-registry-tls\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:27.297019 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.296870 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99939da8-a4f0-44ed-8267-b52d2e31c95e-image-registry-private-configuration\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:27.297019 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.296879 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99939da8-a4f0-44ed-8267-b52d2e31c95e-bound-sa-token\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:27.297019 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.296887 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99939da8-a4f0-44ed-8267-b52d2e31c95e-trusted-ca\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:27.557937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.557907 2580 generic.go:356] "Generic (PLEG): container finished" podID="99939da8-a4f0-44ed-8267-b52d2e31c95e" containerID="4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722" exitCode=0 Jun 11 16:49:27.558080 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.557968 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" Jun 11 16:49:27.558080 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.558003 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" event={"ID":"99939da8-a4f0-44ed-8267-b52d2e31c95e","Type":"ContainerDied","Data":"4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722"} Jun 11 16:49:27.558080 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.558055 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb54b6d99-n4d6z" event={"ID":"99939da8-a4f0-44ed-8267-b52d2e31c95e","Type":"ContainerDied","Data":"f40f8f17500eaf7530f5770c2ab371cbe0e4a14efa920c30bc1708c0e84327c3"} Jun 11 16:49:27.558260 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.558082 2580 scope.go:117] "RemoveContainer" containerID="4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722" Jun 11 16:49:27.567255 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.567241 2580 scope.go:117] "RemoveContainer" containerID="4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722" Jun 11 16:49:27.567556 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:49:27.567534 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722\": container with ID starting with 4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722 not found: ID does not exist" containerID="4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722" Jun 11 16:49:27.567620 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.567565 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722"} err="failed to get container status \"4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722\": rpc error: code = NotFound desc = could not find container \"4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722\": container with ID starting with 4aff96c71fd1036464b52bc4326c3a22b98edeb7cd373570b746cb7f9f2de722 not found: ID does not exist" Jun 11 16:49:27.575430 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.575411 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bb54b6d99-n4d6z"] Jun 11 16:49:27.579303 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:27.579283 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bb54b6d99-n4d6z"] Jun 11 16:49:29.520091 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:29.520057 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99939da8-a4f0-44ed-8267-b52d2e31c95e" path="/var/lib/kubelet/pods/99939da8-a4f0-44ed-8267-b52d2e31c95e/volumes" Jun 11 16:49:34.776030 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:34.775984 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" podUID="d9fbd731-a096-43e7-8488-ce49cbd5cf48" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 16:49:42.545266 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.545200 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d8f46fbc5-qst8n" podUID="457d019b-4dc8-4155-a622-72fc243f3523" containerName="console" containerID="cri-o://d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483" gracePeriod=15 Jun 11 16:49:42.792151 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.792126 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:42.918645 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.918616 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zllq\" (UniqueName: \"kubernetes.io/projected/457d019b-4dc8-4155-a622-72fc243f3523-kube-api-access-5zllq\") pod \"457d019b-4dc8-4155-a622-72fc243f3523\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " Jun 11 16:49:42.918805 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.918658 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-console-config\") pod \"457d019b-4dc8-4155-a622-72fc243f3523\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " Jun 11 16:49:42.918805 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.918691 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-oauth-serving-cert\") pod \"457d019b-4dc8-4155-a622-72fc243f3523\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " Jun 11 16:49:42.918896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.918800 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-trusted-ca-bundle\") pod \"457d019b-4dc8-4155-a622-72fc243f3523\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " Jun 11 16:49:42.918896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.918835 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-oauth-config\") pod \"457d019b-4dc8-4155-a622-72fc243f3523\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " Jun 11 16:49:42.918896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.918856 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-serving-cert\") pod \"457d019b-4dc8-4155-a622-72fc243f3523\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " Jun 11 16:49:42.918896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.918881 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-service-ca\") pod \"457d019b-4dc8-4155-a622-72fc243f3523\" (UID: \"457d019b-4dc8-4155-a622-72fc243f3523\") " Jun 11 16:49:42.919092 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.919046 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "457d019b-4dc8-4155-a622-72fc243f3523" (UID: "457d019b-4dc8-4155-a622-72fc243f3523"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:49:42.919154 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.919119 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-oauth-serving-cert\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:42.919154 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.919128 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-console-config" (OuterVolumeSpecName: "console-config") pod "457d019b-4dc8-4155-a622-72fc243f3523" (UID: "457d019b-4dc8-4155-a622-72fc243f3523"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:49:42.919286 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.919260 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "457d019b-4dc8-4155-a622-72fc243f3523" (UID: "457d019b-4dc8-4155-a622-72fc243f3523"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:49:42.919372 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.919351 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-service-ca" (OuterVolumeSpecName: "service-ca") pod "457d019b-4dc8-4155-a622-72fc243f3523" (UID: "457d019b-4dc8-4155-a622-72fc243f3523"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:49:42.921145 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.921110 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "457d019b-4dc8-4155-a622-72fc243f3523" (UID: "457d019b-4dc8-4155-a622-72fc243f3523"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:49:42.921238 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.921163 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "457d019b-4dc8-4155-a622-72fc243f3523" (UID: "457d019b-4dc8-4155-a622-72fc243f3523"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:49:42.921238 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:42.921177 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457d019b-4dc8-4155-a622-72fc243f3523-kube-api-access-5zllq" (OuterVolumeSpecName: "kube-api-access-5zllq") pod "457d019b-4dc8-4155-a622-72fc243f3523" (UID: "457d019b-4dc8-4155-a622-72fc243f3523"). InnerVolumeSpecName "kube-api-access-5zllq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:49:43.019712 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.019675 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-service-ca\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:43.019712 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.019704 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zllq\" (UniqueName: \"kubernetes.io/projected/457d019b-4dc8-4155-a622-72fc243f3523-kube-api-access-5zllq\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:43.019712 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.019715 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-console-config\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:43.019920 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.019723 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/457d019b-4dc8-4155-a622-72fc243f3523-trusted-ca-bundle\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:43.019920 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.019731 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-oauth-config\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:43.019920 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.019739 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/457d019b-4dc8-4155-a622-72fc243f3523-console-serving-cert\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:49:43.614578 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.614545 2580 generic.go:356] "Generic (PLEG): container finished" podID="457d019b-4dc8-4155-a622-72fc243f3523" containerID="d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483" exitCode=0 Jun 11 16:49:43.614954 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.614586 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8f46fbc5-qst8n" Jun 11 16:49:43.614954 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.614626 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8f46fbc5-qst8n" event={"ID":"457d019b-4dc8-4155-a622-72fc243f3523","Type":"ContainerDied","Data":"d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483"} Jun 11 16:49:43.614954 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.614675 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8f46fbc5-qst8n" event={"ID":"457d019b-4dc8-4155-a622-72fc243f3523","Type":"ContainerDied","Data":"fc26d1273bbf1ccc58229511eeba93e0acea931d2a469ece67d3782383d15dc6"} Jun 11 16:49:43.614954 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.614696 2580 scope.go:117] "RemoveContainer" containerID="d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483" Jun 11 16:49:43.622678 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.622664 2580 scope.go:117] "RemoveContainer" containerID="d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483" Jun 11 16:49:43.622910 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:49:43.622895 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483\": container with ID starting with d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483 not found: ID does not exist" containerID="d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483" Jun 11 16:49:43.622954 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.622918 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483"} err="failed to get container status \"d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483\": rpc error: code = NotFound desc = could not find container \"d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483\": container with ID starting with d14a9a43c8fd7676c12063df047d7f2a7d51fcac0c16bd3aced8c40d9f4e8483 not found: ID does not exist" Jun 11 16:49:43.631312 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.631291 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d8f46fbc5-qst8n"] Jun 11 16:49:43.636182 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:43.636162 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d8f46fbc5-qst8n"] Jun 11 16:49:44.775228 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:44.775184 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" podUID="d9fbd731-a096-43e7-8488-ce49cbd5cf48" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 16:49:45.520522 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:45.520491 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="457d019b-4dc8-4155-a622-72fc243f3523" path="/var/lib/kubelet/pods/457d019b-4dc8-4155-a622-72fc243f3523/volumes" Jun 11 16:49:51.148595 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:51.148527 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fd824_49e31301-ebf6-493b-91e9-2525a50c4dd6/serve-healthcheck-canary/0.log" Jun 11 16:49:54.775744 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:54.775703 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" podUID="d9fbd731-a096-43e7-8488-ce49cbd5cf48" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 16:49:54.776180 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:54.775783 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" Jun 11 16:49:54.776252 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:54.776217 2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"961edebd9dba745cbc02d898a68ef2d7b189062c3bae475be4551cd0464da0b1"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 16:49:54.776294 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:54.776254 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" podUID="d9fbd731-a096-43e7-8488-ce49cbd5cf48" containerName="service-proxy" containerID="cri-o://961edebd9dba745cbc02d898a68ef2d7b189062c3bae475be4551cd0464da0b1" gracePeriod=30 Jun 11 16:49:55.658832 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:55.658790 2580 generic.go:356] "Generic (PLEG): container finished" podID="d9fbd731-a096-43e7-8488-ce49cbd5cf48" containerID="961edebd9dba745cbc02d898a68ef2d7b189062c3bae475be4551cd0464da0b1" exitCode=2 Jun 11 16:49:55.658999 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:55.658871 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" event={"ID":"d9fbd731-a096-43e7-8488-ce49cbd5cf48","Type":"ContainerDied","Data":"961edebd9dba745cbc02d898a68ef2d7b189062c3bae475be4551cd0464da0b1"} Jun 11 16:49:55.658999 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:49:55.658913 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6db8fdc686-cfkzx" event={"ID":"d9fbd731-a096-43e7-8488-ce49cbd5cf48","Type":"ContainerStarted","Data":"1ffb570639cd77e15fc0e3c2d736006045876090d8c6406f9380f348124315b8"} Jun 11 16:50:21.318176 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:50:21.318139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:50:21.320640 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:50:21.320615 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0682191c-9cec-4f46-a400-6053e8f3e033-metrics-certs\") pod \"network-metrics-daemon-f226j\" (UID: \"0682191c-9cec-4f46-a400-6053e8f3e033\") " pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:50:21.519607 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:50:21.519581 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bmxfr\"" Jun 11 16:50:21.527556 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:50:21.527537 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f226j" Jun 11 16:50:21.656722 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:50:21.656691 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f226j"] Jun 11 16:50:21.660032 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:50:21.660006 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0682191c_9cec_4f46_a400_6053e8f3e033.slice/crio-fe967865b1c6af846af715d18f7d9a1734a27d5c7a0149efd32acbfce8596e02 WatchSource:0}: Error finding container fe967865b1c6af846af715d18f7d9a1734a27d5c7a0149efd32acbfce8596e02: Status 404 returned error can't find the container with id fe967865b1c6af846af715d18f7d9a1734a27d5c7a0149efd32acbfce8596e02 Jun 11 16:50:21.751180 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:50:21.751147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f226j" event={"ID":"0682191c-9cec-4f46-a400-6053e8f3e033","Type":"ContainerStarted","Data":"fe967865b1c6af846af715d18f7d9a1734a27d5c7a0149efd32acbfce8596e02"} Jun 11 16:50:22.756264 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:50:22.756219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f226j" event={"ID":"0682191c-9cec-4f46-a400-6053e8f3e033","Type":"ContainerStarted","Data":"b5056a7ab4869bbffc9c825ece69591b427f060fd09bc2157a467d72a6853e60"} Jun 11 16:50:22.756601 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:50:22.756287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f226j" event={"ID":"0682191c-9cec-4f46-a400-6053e8f3e033","Type":"ContainerStarted","Data":"b02bca359a35a1aa5a43358700434eb98f8d0bd4f0e6fe671077264ea323fd80"} Jun 11 16:50:22.773396 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:50:22.773319 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f226j" podStartSLOduration=374.916221439 podStartE2EDuration="6m15.773306184s" totalImagesPullingTime="857.084745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:50:22.772360743 +0000 UTC m=+375.750836273" watchObservedRunningTime="2026-06-11 16:50:22.773306184 +0000 UTC m=+375.751781712" Jun 11 16:51:40.044694 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.044610 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf"] Jun 11 16:51:40.045119 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.044890 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99939da8-a4f0-44ed-8267-b52d2e31c95e" containerName="registry" Jun 11 16:51:40.045119 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.044901 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="99939da8-a4f0-44ed-8267-b52d2e31c95e" containerName="registry" Jun 11 16:51:40.045119 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.044911 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457d019b-4dc8-4155-a622-72fc243f3523" containerName="console" Jun 11 16:51:40.045119 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.044916 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="457d019b-4dc8-4155-a622-72fc243f3523" containerName="console" Jun 11 16:51:40.045119 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.044965 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="99939da8-a4f0-44ed-8267-b52d2e31c95e" containerName="registry" Jun 11 16:51:40.045119 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.044973 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="457d019b-4dc8-4155-a622-72fc243f3523" containerName="console" Jun 11 16:51:40.047952 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.047936 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:51:40.051041 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.051023 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:51:40.051748 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.051730 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:51:40.051848 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.051742 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h7k7\"" Jun 11 16:51:40.059007 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.058977 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf"] Jun 11 16:51:40.073740 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.073716 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48cc6\" (UniqueName: \"kubernetes.io/projected/35622cf8-7187-4924-a843-4f54f7b71f3d-kube-api-access-48cc6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:51:40.073834 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.073755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:51:40.073876 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.073841 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:51:40.175022 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.174987 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cc6\" (UniqueName: \"kubernetes.io/projected/35622cf8-7187-4924-a843-4f54f7b71f3d-kube-api-access-48cc6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:51:40.175136 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.175032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:51:40.175136 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.175065 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:51:40.175410 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.175395 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:51:40.175461 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.175425 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:51:40.184388 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.184364 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48cc6\" (UniqueName: \"kubernetes.io/projected/35622cf8-7187-4924-a843-4f54f7b71f3d-kube-api-access-48cc6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:51:40.357138 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.357060 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:51:40.480855 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:40.480808 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf"] Jun 11 16:51:40.483613 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:51:40.483583 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35622cf8_7187_4924_a843_4f54f7b71f3d.slice/crio-29e52783a11f5e58bdd398c17dd899a5e8e4e370089aa7dc4dadf29ab0c1f7c9 WatchSource:0}: Error finding container 29e52783a11f5e58bdd398c17dd899a5e8e4e370089aa7dc4dadf29ab0c1f7c9: Status 404 returned error can't find the container with id 29e52783a11f5e58bdd398c17dd899a5e8e4e370089aa7dc4dadf29ab0c1f7c9 Jun 11 16:51:41.025645 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:41.025605 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" event={"ID":"35622cf8-7187-4924-a843-4f54f7b71f3d","Type":"ContainerStarted","Data":"29e52783a11f5e58bdd398c17dd899a5e8e4e370089aa7dc4dadf29ab0c1f7c9"} Jun 11 16:51:50.060690 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:50.060655 2580 generic.go:356] "Generic (PLEG): container finished" podID="35622cf8-7187-4924-a843-4f54f7b71f3d" containerID="3389c6f0594e2e3a4b3659845c4572af13b4d1f235196d260023478bf210cf09" exitCode=0 Jun 11 16:51:50.061088 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:50.060728 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" event={"ID":"35622cf8-7187-4924-a843-4f54f7b71f3d","Type":"ContainerDied","Data":"3389c6f0594e2e3a4b3659845c4572af13b4d1f235196d260023478bf210cf09"} Jun 11 16:51:53.073097 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:53.073052 2580 generic.go:356] "Generic (PLEG): container finished" podID="35622cf8-7187-4924-a843-4f54f7b71f3d" containerID="d61464d1382062ad51703734c77f6b40ec35946550064c7080fbcf415a88b484" exitCode=0 Jun 11 16:51:53.073596 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:51:53.073111 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" event={"ID":"35622cf8-7187-4924-a843-4f54f7b71f3d","Type":"ContainerDied","Data":"d61464d1382062ad51703734c77f6b40ec35946550064c7080fbcf415a88b484"} Jun 11 16:52:01.106822 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:01.106778 2580 generic.go:356] "Generic (PLEG): container finished" podID="35622cf8-7187-4924-a843-4f54f7b71f3d" containerID="6d9ffd2d195aa6b573ece82fa5aa4310d39673a8c988d745d5f5ba79f6b90097" exitCode=0 Jun 11 16:52:01.107194 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:01.106866 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" event={"ID":"35622cf8-7187-4924-a843-4f54f7b71f3d","Type":"ContainerDied","Data":"6d9ffd2d195aa6b573ece82fa5aa4310d39673a8c988d745d5f5ba79f6b90097"} Jun 11 16:52:02.268770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:02.268735 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:52:02.351923 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:02.351870 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48cc6\" (UniqueName: \"kubernetes.io/projected/35622cf8-7187-4924-a843-4f54f7b71f3d-kube-api-access-48cc6\") pod \"35622cf8-7187-4924-a843-4f54f7b71f3d\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " Jun 11 16:52:02.351923 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:02.351927 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-bundle\") pod \"35622cf8-7187-4924-a843-4f54f7b71f3d\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " Jun 11 16:52:02.352116 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:02.352102 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-util\") pod \"35622cf8-7187-4924-a843-4f54f7b71f3d\" (UID: \"35622cf8-7187-4924-a843-4f54f7b71f3d\") " Jun 11 16:52:02.352683 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:02.352653 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-bundle" (OuterVolumeSpecName: "bundle") pod "35622cf8-7187-4924-a843-4f54f7b71f3d" (UID: "35622cf8-7187-4924-a843-4f54f7b71f3d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:52:02.354703 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:02.354676 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35622cf8-7187-4924-a843-4f54f7b71f3d-kube-api-access-48cc6" (OuterVolumeSpecName: "kube-api-access-48cc6") pod "35622cf8-7187-4924-a843-4f54f7b71f3d" (UID: "35622cf8-7187-4924-a843-4f54f7b71f3d"). InnerVolumeSpecName "kube-api-access-48cc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:52:02.356986 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:02.356963 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-util" (OuterVolumeSpecName: "util") pod "35622cf8-7187-4924-a843-4f54f7b71f3d" (UID: "35622cf8-7187-4924-a843-4f54f7b71f3d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:52:02.453303 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:02.453233 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48cc6\" (UniqueName: \"kubernetes.io/projected/35622cf8-7187-4924-a843-4f54f7b71f3d-kube-api-access-48cc6\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:52:02.453303 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:02.453258 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-bundle\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:52:02.453303 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:02.453267 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35622cf8-7187-4924-a843-4f54f7b71f3d-util\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:52:03.116279 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:03.116246 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" event={"ID":"35622cf8-7187-4924-a843-4f54f7b71f3d","Type":"ContainerDied","Data":"29e52783a11f5e58bdd398c17dd899a5e8e4e370089aa7dc4dadf29ab0c1f7c9"} Jun 11 16:52:03.116279 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:03.116275 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzrxlf" Jun 11 16:52:03.116492 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:03.116291 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29e52783a11f5e58bdd398c17dd899a5e8e4e370089aa7dc4dadf29ab0c1f7c9" Jun 11 16:52:08.158923 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.158890 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs"] Jun 11 16:52:08.159379 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.159189 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35622cf8-7187-4924-a843-4f54f7b71f3d" containerName="extract" Jun 11 16:52:08.159379 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.159205 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35622cf8-7187-4924-a843-4f54f7b71f3d" containerName="extract" Jun 11 16:52:08.159379 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.159216 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35622cf8-7187-4924-a843-4f54f7b71f3d" containerName="pull" Jun 11 16:52:08.159379 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.159221 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35622cf8-7187-4924-a843-4f54f7b71f3d" containerName="pull" Jun 11 16:52:08.159379 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.159233 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35622cf8-7187-4924-a843-4f54f7b71f3d" containerName="util" Jun 11 16:52:08.159379 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.159239 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35622cf8-7187-4924-a843-4f54f7b71f3d" containerName="util" Jun 11 16:52:08.159379 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.159289 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35622cf8-7187-4924-a843-4f54f7b71f3d" containerName="extract" Jun 11 16:52:08.163751 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.163734 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs" Jun 11 16:52:08.166060 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.166034 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:52:08.166060 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.166050 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7m5bc\"" Jun 11 16:52:08.166225 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.166089 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 16:52:08.178509 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.178484 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs"] Jun 11 16:52:08.294232 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.294204 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2whg4\" (UniqueName: \"kubernetes.io/projected/637c46bb-7b01-4713-8d60-b47cf685618a-kube-api-access-2whg4\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zt7xs\" (UID: \"637c46bb-7b01-4713-8d60-b47cf685618a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs" Jun 11 16:52:08.294398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.294244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637c46bb-7b01-4713-8d60-b47cf685618a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zt7xs\" (UID: \"637c46bb-7b01-4713-8d60-b47cf685618a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs" Jun 11 16:52:08.395061 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.395021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2whg4\" (UniqueName: \"kubernetes.io/projected/637c46bb-7b01-4713-8d60-b47cf685618a-kube-api-access-2whg4\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zt7xs\" (UID: \"637c46bb-7b01-4713-8d60-b47cf685618a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs" Jun 11 16:52:08.395229 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.395073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637c46bb-7b01-4713-8d60-b47cf685618a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zt7xs\" (UID: \"637c46bb-7b01-4713-8d60-b47cf685618a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs" Jun 11 16:52:08.395400 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.395385 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637c46bb-7b01-4713-8d60-b47cf685618a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zt7xs\" (UID: \"637c46bb-7b01-4713-8d60-b47cf685618a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs" Jun 11 16:52:08.403774 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.403745 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2whg4\" (UniqueName: \"kubernetes.io/projected/637c46bb-7b01-4713-8d60-b47cf685618a-kube-api-access-2whg4\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zt7xs\" (UID: \"637c46bb-7b01-4713-8d60-b47cf685618a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs" Jun 11 16:52:08.472339 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.472250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs" Jun 11 16:52:08.608531 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:08.608495 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs"] Jun 11 16:52:08.611644 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:52:08.611609 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637c46bb_7b01_4713_8d60_b47cf685618a.slice/crio-3f3107e2c344f068a0e113a9e6a42c7643a06e152d874ab22dc1a37b9a4c1a4d WatchSource:0}: Error finding container 3f3107e2c344f068a0e113a9e6a42c7643a06e152d874ab22dc1a37b9a4c1a4d: Status 404 returned error can't find the container with id 3f3107e2c344f068a0e113a9e6a42c7643a06e152d874ab22dc1a37b9a4c1a4d Jun 11 16:52:09.139688 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:09.139657 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs" event={"ID":"637c46bb-7b01-4713-8d60-b47cf685618a","Type":"ContainerStarted","Data":"3f3107e2c344f068a0e113a9e6a42c7643a06e152d874ab22dc1a37b9a4c1a4d"} Jun 11 16:52:13.161207 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:13.161161 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs" event={"ID":"637c46bb-7b01-4713-8d60-b47cf685618a","Type":"ContainerStarted","Data":"ebe3d4e5cfbe19d9c1ce5cc850796dac5d5cf93fec450c005f93edba78a9d6b2"} Jun 11 16:52:13.190386 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:13.190328 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zt7xs" podStartSLOduration=1.19566602 podStartE2EDuration="5.19031276s" totalImagesPullingTime="3.99464674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:13.188943512 +0000 UTC m=+486.167419041" watchObservedRunningTime="2026-06-11 16:52:13.19031276 +0000 UTC m=+486.168788290" Jun 11 16:52:14.276887 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.276850 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9"] Jun 11 16:52:14.280256 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.280232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:14.284049 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.284026 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:52:14.284175 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.284160 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:52:14.284775 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.284761 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h7k7\"" Jun 11 16:52:14.312966 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.312943 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9"] Jun 11 16:52:14.340028 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.339995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:14.340173 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.340041 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:14.340173 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.340061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr9vb\" (UniqueName: \"kubernetes.io/projected/0279c699-dd26-4e81-be81-ed20c9b009bb-kube-api-access-tr9vb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:14.441211 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.441173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:14.441211 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.441209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr9vb\" (UniqueName: \"kubernetes.io/projected/0279c699-dd26-4e81-be81-ed20c9b009bb-kube-api-access-tr9vb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:14.441423 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.441251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:14.441687 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.441658 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:14.441808 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.441663 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:14.455412 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.455387 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr9vb\" (UniqueName: \"kubernetes.io/projected/0279c699-dd26-4e81-be81-ed20c9b009bb-kube-api-access-tr9vb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:14.588703 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.588624 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:14.741025 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:14.740989 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9"] Jun 11 16:52:14.745051 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:52:14.745021 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0279c699_dd26_4e81_be81_ed20c9b009bb.slice/crio-c8fa7cd1d630cd4539b59601ec8e4cc1d16f1c51cadf88e89277cac6d2c2fb09 WatchSource:0}: Error finding container c8fa7cd1d630cd4539b59601ec8e4cc1d16f1c51cadf88e89277cac6d2c2fb09: Status 404 returned error can't find the container with id c8fa7cd1d630cd4539b59601ec8e4cc1d16f1c51cadf88e89277cac6d2c2fb09 Jun 11 16:52:15.170436 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:15.170406 2580 generic.go:356] "Generic (PLEG): container finished" podID="0279c699-dd26-4e81-be81-ed20c9b009bb" containerID="7f88e7b894ffd9baa2543d138779b859a79dd8ed153758361adccd09856ce5f7" exitCode=0 Jun 11 16:52:15.170614 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:15.170485 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" event={"ID":"0279c699-dd26-4e81-be81-ed20c9b009bb","Type":"ContainerDied","Data":"7f88e7b894ffd9baa2543d138779b859a79dd8ed153758361adccd09856ce5f7"} Jun 11 16:52:15.170614 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:15.170545 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" event={"ID":"0279c699-dd26-4e81-be81-ed20c9b009bb","Type":"ContainerStarted","Data":"c8fa7cd1d630cd4539b59601ec8e4cc1d16f1c51cadf88e89277cac6d2c2fb09"} Jun 11 16:52:17.171485 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.171434 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-c58nk"] Jun 11 16:52:17.183118 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.183086 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-c58nk" Jun 11 16:52:17.186175 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.186096 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 16:52:17.186175 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.186120 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-th7qk\"" Jun 11 16:52:17.186175 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.186174 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 16:52:17.190883 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.190834 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-c58nk"] Jun 11 16:52:17.266132 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.266100 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shd2q\" (UniqueName: \"kubernetes.io/projected/2650c62e-724b-4efa-9f20-fdb9ec774b19-kube-api-access-shd2q\") pod \"cert-manager-cainjector-5d99449ffd-c58nk\" (UID: \"2650c62e-724b-4efa-9f20-fdb9ec774b19\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-c58nk" Jun 11 16:52:17.266295 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.266147 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2650c62e-724b-4efa-9f20-fdb9ec774b19-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-c58nk\" (UID: \"2650c62e-724b-4efa-9f20-fdb9ec774b19\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-c58nk" Jun 11 16:52:17.367329 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.367303 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shd2q\" (UniqueName: \"kubernetes.io/projected/2650c62e-724b-4efa-9f20-fdb9ec774b19-kube-api-access-shd2q\") pod \"cert-manager-cainjector-5d99449ffd-c58nk\" (UID: \"2650c62e-724b-4efa-9f20-fdb9ec774b19\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-c58nk" Jun 11 16:52:17.367432 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.367340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2650c62e-724b-4efa-9f20-fdb9ec774b19-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-c58nk\" (UID: \"2650c62e-724b-4efa-9f20-fdb9ec774b19\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-c58nk" Jun 11 16:52:17.377253 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.377231 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shd2q\" (UniqueName: \"kubernetes.io/projected/2650c62e-724b-4efa-9f20-fdb9ec774b19-kube-api-access-shd2q\") pod \"cert-manager-cainjector-5d99449ffd-c58nk\" (UID: \"2650c62e-724b-4efa-9f20-fdb9ec774b19\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-c58nk" Jun 11 16:52:17.377360 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.377234 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2650c62e-724b-4efa-9f20-fdb9ec774b19-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-c58nk\" (UID: \"2650c62e-724b-4efa-9f20-fdb9ec774b19\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-c58nk" Jun 11 16:52:17.494910 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.494879 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-c58nk" Jun 11 16:52:17.627088 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:17.627058 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-c58nk"] Jun 11 16:52:17.630091 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:52:17.630067 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2650c62e_724b_4efa_9f20_fdb9ec774b19.slice/crio-cfb7707004ec27a3cdb20e676fa02360936a381e6212f747aab18caed7492e5e WatchSource:0}: Error finding container cfb7707004ec27a3cdb20e676fa02360936a381e6212f747aab18caed7492e5e: Status 404 returned error can't find the container with id cfb7707004ec27a3cdb20e676fa02360936a381e6212f747aab18caed7492e5e Jun 11 16:52:18.185509 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:18.185472 2580 generic.go:356] "Generic (PLEG): container finished" podID="0279c699-dd26-4e81-be81-ed20c9b009bb" containerID="3000a686355565fa83b57dc4d45baacabf452d03d771dbcbda1225ff843021e8" exitCode=0 Jun 11 16:52:18.185933 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:18.185552 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" event={"ID":"0279c699-dd26-4e81-be81-ed20c9b009bb","Type":"ContainerDied","Data":"3000a686355565fa83b57dc4d45baacabf452d03d771dbcbda1225ff843021e8"} Jun 11 16:52:18.186734 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:18.186702 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-c58nk" event={"ID":"2650c62e-724b-4efa-9f20-fdb9ec774b19","Type":"ContainerStarted","Data":"cfb7707004ec27a3cdb20e676fa02360936a381e6212f747aab18caed7492e5e"} Jun 11 16:52:19.194383 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:19.194352 2580 generic.go:356] "Generic (PLEG): container finished" podID="0279c699-dd26-4e81-be81-ed20c9b009bb" containerID="5934d2c16dba25e0df07f43bb43005e8d95a076934db7280063a2114809772f6" exitCode=0 Jun 11 16:52:19.194849 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:19.194426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" event={"ID":"0279c699-dd26-4e81-be81-ed20c9b009bb","Type":"ContainerDied","Data":"5934d2c16dba25e0df07f43bb43005e8d95a076934db7280063a2114809772f6"} Jun 11 16:52:20.323952 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:20.323926 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:20.394712 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:20.394679 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr9vb\" (UniqueName: \"kubernetes.io/projected/0279c699-dd26-4e81-be81-ed20c9b009bb-kube-api-access-tr9vb\") pod \"0279c699-dd26-4e81-be81-ed20c9b009bb\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " Jun 11 16:52:20.394850 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:20.394721 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-bundle\") pod \"0279c699-dd26-4e81-be81-ed20c9b009bb\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " Jun 11 16:52:20.394850 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:20.394775 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-util\") pod \"0279c699-dd26-4e81-be81-ed20c9b009bb\" (UID: \"0279c699-dd26-4e81-be81-ed20c9b009bb\") " Jun 11 16:52:20.395154 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:20.395130 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-bundle" (OuterVolumeSpecName: "bundle") pod "0279c699-dd26-4e81-be81-ed20c9b009bb" (UID: "0279c699-dd26-4e81-be81-ed20c9b009bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:52:20.396898 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:20.396877 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0279c699-dd26-4e81-be81-ed20c9b009bb-kube-api-access-tr9vb" (OuterVolumeSpecName: "kube-api-access-tr9vb") pod "0279c699-dd26-4e81-be81-ed20c9b009bb" (UID: "0279c699-dd26-4e81-be81-ed20c9b009bb"). InnerVolumeSpecName "kube-api-access-tr9vb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:52:20.401988 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:20.401962 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-util" (OuterVolumeSpecName: "util") pod "0279c699-dd26-4e81-be81-ed20c9b009bb" (UID: "0279c699-dd26-4e81-be81-ed20c9b009bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:52:20.495949 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:20.495872 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr9vb\" (UniqueName: \"kubernetes.io/projected/0279c699-dd26-4e81-be81-ed20c9b009bb-kube-api-access-tr9vb\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:52:20.495949 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:20.495900 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-bundle\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:52:20.495949 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:20.495909 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0279c699-dd26-4e81-be81-ed20c9b009bb-util\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:52:21.204164 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:21.204137 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" Jun 11 16:52:21.204366 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:21.204132 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpzz9" event={"ID":"0279c699-dd26-4e81-be81-ed20c9b009bb","Type":"ContainerDied","Data":"c8fa7cd1d630cd4539b59601ec8e4cc1d16f1c51cadf88e89277cac6d2c2fb09"} Jun 11 16:52:21.204366 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:21.204269 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8fa7cd1d630cd4539b59601ec8e4cc1d16f1c51cadf88e89277cac6d2c2fb09" Jun 11 16:52:21.205755 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:21.205724 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-c58nk" event={"ID":"2650c62e-724b-4efa-9f20-fdb9ec774b19","Type":"ContainerStarted","Data":"6f02b133eb19f60fa111270d3fb282aa14412699a73bcddc4a667d1c8349a7aa"} Jun 11 16:52:21.230038 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:21.229979 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-c58nk" podStartSLOduration=1.6258771730000001 podStartE2EDuration="4.2299628s" totalImagesPullingTime="2.604085627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:21.229721433 +0000 UTC m=+494.208196963" watchObservedRunningTime="2026-06-11 16:52:21.2299628 +0000 UTC m=+494.208438331" Jun 11 16:52:26.459560 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.459523 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42"] Jun 11 16:52:26.459902 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.459800 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0279c699-dd26-4e81-be81-ed20c9b009bb" containerName="pull" Jun 11 16:52:26.459902 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.459812 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0279c699-dd26-4e81-be81-ed20c9b009bb" containerName="pull" Jun 11 16:52:26.459902 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.459822 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0279c699-dd26-4e81-be81-ed20c9b009bb" containerName="util" Jun 11 16:52:26.459902 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.459827 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0279c699-dd26-4e81-be81-ed20c9b009bb" containerName="util" Jun 11 16:52:26.459902 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.459833 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0279c699-dd26-4e81-be81-ed20c9b009bb" containerName="extract" Jun 11 16:52:26.459902 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.459839 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0279c699-dd26-4e81-be81-ed20c9b009bb" containerName="extract" Jun 11 16:52:26.460083 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.459909 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0279c699-dd26-4e81-be81-ed20c9b009bb" containerName="extract" Jun 11 16:52:26.483867 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.483835 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42"] Jun 11 16:52:26.484002 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.483928 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42" Jun 11 16:52:26.486496 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.486471 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 16:52:26.486590 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.486471 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:52:26.487153 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.487134 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4xpft\"" Jun 11 16:52:26.642799 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.642767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc697f82-382a-4a87-8010-ea86ea76fe3b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8zm42\" (UID: \"dc697f82-382a-4a87-8010-ea86ea76fe3b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42" Jun 11 16:52:26.642974 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.642813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbks8\" (UniqueName: \"kubernetes.io/projected/dc697f82-382a-4a87-8010-ea86ea76fe3b-kube-api-access-xbks8\") pod \"openshift-lws-operator-fd8ccff4c-8zm42\" (UID: \"dc697f82-382a-4a87-8010-ea86ea76fe3b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42" Jun 11 16:52:26.744161 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.744080 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbks8\" (UniqueName: \"kubernetes.io/projected/dc697f82-382a-4a87-8010-ea86ea76fe3b-kube-api-access-xbks8\") pod \"openshift-lws-operator-fd8ccff4c-8zm42\" (UID: \"dc697f82-382a-4a87-8010-ea86ea76fe3b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42" Jun 11 16:52:26.744161 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.744146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc697f82-382a-4a87-8010-ea86ea76fe3b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8zm42\" (UID: \"dc697f82-382a-4a87-8010-ea86ea76fe3b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42" Jun 11 16:52:26.744505 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.744484 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc697f82-382a-4a87-8010-ea86ea76fe3b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8zm42\" (UID: \"dc697f82-382a-4a87-8010-ea86ea76fe3b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42" Jun 11 16:52:26.753223 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.753194 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbks8\" (UniqueName: \"kubernetes.io/projected/dc697f82-382a-4a87-8010-ea86ea76fe3b-kube-api-access-xbks8\") pod \"openshift-lws-operator-fd8ccff4c-8zm42\" (UID: \"dc697f82-382a-4a87-8010-ea86ea76fe3b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42" Jun 11 16:52:26.793169 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.793124 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42" Jun 11 16:52:26.991401 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:26.991370 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42"] Jun 11 16:52:27.018018 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:52:27.017975 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc697f82_382a_4a87_8010_ea86ea76fe3b.slice/crio-6ceec81a613b5cb75c20a5dec604cfe3e556604be1f2f04632000fc403b763aa WatchSource:0}: Error finding container 6ceec81a613b5cb75c20a5dec604cfe3e556604be1f2f04632000fc403b763aa: Status 404 returned error can't find the container with id 6ceec81a613b5cb75c20a5dec604cfe3e556604be1f2f04632000fc403b763aa Jun 11 16:52:27.230400 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:27.230364 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42" event={"ID":"dc697f82-382a-4a87-8010-ea86ea76fe3b","Type":"ContainerStarted","Data":"6ceec81a613b5cb75c20a5dec604cfe3e556604be1f2f04632000fc403b763aa"} Jun 11 16:52:30.245814 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:30.245773 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42" event={"ID":"dc697f82-382a-4a87-8010-ea86ea76fe3b","Type":"ContainerStarted","Data":"098cffb3c112a61411039a858835d2a5d9dbaae942ed54efc3aef51d2ae4eb7c"} Jun 11 16:52:30.266990 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:30.266941 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zm42" podStartSLOduration=1.6387675800000001 podStartE2EDuration="4.26692621s" totalImagesPullingTime="2.62815863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:30.265905361 +0000 UTC m=+503.244380902" watchObservedRunningTime="2026-06-11 16:52:30.26692621 +0000 UTC m=+503.245401810" Jun 11 16:52:32.866196 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:32.866161 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w"] Jun 11 16:52:32.872916 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:32.872888 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:32.876422 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:32.876363 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:52:32.876422 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:32.876404 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h7k7\"" Jun 11 16:52:32.877152 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:32.877131 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:52:32.879180 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:32.879160 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w"] Jun 11 16:52:32.992718 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:32.992682 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:32.992895 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:32.992724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpgf8\" (UniqueName: \"kubernetes.io/projected/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-kube-api-access-zpgf8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:32.992895 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:32.992789 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:33.093248 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:33.093221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:33.093415 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:33.093256 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpgf8\" (UniqueName: \"kubernetes.io/projected/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-kube-api-access-zpgf8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:33.093415 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:33.093283 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:33.093705 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:33.093686 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:33.093740 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:33.093702 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:33.102334 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:33.102308 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpgf8\" (UniqueName: \"kubernetes.io/projected/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-kube-api-access-zpgf8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:33.183212 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:33.183142 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:33.314971 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:33.314948 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w"] Jun 11 16:52:33.317478 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:52:33.317430 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b1a0fd_e043_4f2f_9d61_f2bfaeb6b74f.slice/crio-dd143990d7085b7abf7a382db4afc01e6fd6bfb83d5aa1a4d0242af8fb08a8fb WatchSource:0}: Error finding container dd143990d7085b7abf7a382db4afc01e6fd6bfb83d5aa1a4d0242af8fb08a8fb: Status 404 returned error can't find the container with id dd143990d7085b7abf7a382db4afc01e6fd6bfb83d5aa1a4d0242af8fb08a8fb Jun 11 16:52:34.262682 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:34.262647 2580 generic.go:356] "Generic (PLEG): container finished" podID="96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" containerID="70c74830365621f7de2c665f804a084d57e205c9c7f9078dbf3c2e9560b9b797" exitCode=0 Jun 11 16:52:34.263050 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:34.262734 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" event={"ID":"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f","Type":"ContainerDied","Data":"70c74830365621f7de2c665f804a084d57e205c9c7f9078dbf3c2e9560b9b797"} Jun 11 16:52:34.263050 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:34.262798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" event={"ID":"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f","Type":"ContainerStarted","Data":"dd143990d7085b7abf7a382db4afc01e6fd6bfb83d5aa1a4d0242af8fb08a8fb"} Jun 11 16:52:35.268660 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:35.268568 2580 generic.go:356] "Generic (PLEG): container finished" podID="96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" containerID="e8e177276faafc10f70a61f355d3d4e848859a6a51c8c762f080f2915bd383a5" exitCode=0 Jun 11 16:52:35.268660 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:35.268638 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" event={"ID":"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f","Type":"ContainerDied","Data":"e8e177276faafc10f70a61f355d3d4e848859a6a51c8c762f080f2915bd383a5"} Jun 11 16:52:36.274337 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:36.274304 2580 generic.go:356] "Generic (PLEG): container finished" podID="96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" containerID="10db977654063c61a5769d9bb390f10677a05e1d12764ec3b990df3d4abbcf24" exitCode=0 Jun 11 16:52:36.274770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:36.274375 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" event={"ID":"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f","Type":"ContainerDied","Data":"10db977654063c61a5769d9bb390f10677a05e1d12764ec3b990df3d4abbcf24"} Jun 11 16:52:37.400269 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:37.400248 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:37.527017 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:37.526994 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpgf8\" (UniqueName: \"kubernetes.io/projected/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-kube-api-access-zpgf8\") pod \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " Jun 11 16:52:37.527212 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:37.527043 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-util\") pod \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " Jun 11 16:52:37.527212 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:37.527083 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-bundle\") pod \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\" (UID: \"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f\") " Jun 11 16:52:37.527790 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:37.527765 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-bundle" (OuterVolumeSpecName: "bundle") pod "96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" (UID: "96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:52:37.529155 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:37.529122 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-kube-api-access-zpgf8" (OuterVolumeSpecName: "kube-api-access-zpgf8") pod "96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" (UID: "96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f"). InnerVolumeSpecName "kube-api-access-zpgf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:52:37.532631 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:37.532575 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-util" (OuterVolumeSpecName: "util") pod "96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" (UID: "96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:52:37.627653 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:37.627620 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-util\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:52:37.627653 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:37.627651 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-bundle\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:52:37.627846 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:37.627665 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpgf8\" (UniqueName: \"kubernetes.io/projected/96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f-kube-api-access-zpgf8\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:52:38.286606 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:38.286575 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" Jun 11 16:52:38.286752 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:38.286575 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpbc8w" event={"ID":"96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f","Type":"ContainerDied","Data":"dd143990d7085b7abf7a382db4afc01e6fd6bfb83d5aa1a4d0242af8fb08a8fb"} Jun 11 16:52:38.286752 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:38.286727 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd143990d7085b7abf7a382db4afc01e6fd6bfb83d5aa1a4d0242af8fb08a8fb" Jun 11 16:52:50.211504 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.211402 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2"] Jun 11 16:52:50.211989 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.211739 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" containerName="util" Jun 11 16:52:50.211989 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.211752 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" containerName="util" Jun 11 16:52:50.211989 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.211761 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" containerName="extract" Jun 11 16:52:50.211989 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.211769 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" containerName="extract" Jun 11 16:52:50.211989 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.211785 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" containerName="pull" Jun 11 16:52:50.211989 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.211791 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" containerName="pull" Jun 11 16:52:50.211989 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.211839 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="96b1a0fd-e043-4f2f-9d61-f2bfaeb6b74f" containerName="extract" Jun 11 16:52:50.214749 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.214733 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.219878 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.219857 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vh62b\"" Jun 11 16:52:50.220008 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.219858 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 16:52:50.220197 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.220153 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 16:52:50.220197 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.220188 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 16:52:50.220557 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.220539 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 16:52:50.227489 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.227470 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c128f70-8b95-453e-84d1-03769c16daa1-tmp\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.227583 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.227507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c128f70-8b95-453e-84d1-03769c16daa1-manifests\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.227583 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.227546 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2xp\" (UniqueName: \"kubernetes.io/projected/8c128f70-8b95-453e-84d1-03769c16daa1-kube-api-access-gd2xp\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.227583 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.227569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c128f70-8b95-453e-84d1-03769c16daa1-webhook-cert\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.227718 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.227594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c128f70-8b95-453e-84d1-03769c16daa1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.237969 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.237939 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2"] Jun 11 16:52:50.328013 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.327973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c128f70-8b95-453e-84d1-03769c16daa1-manifests\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.328202 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.328025 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2xp\" (UniqueName: \"kubernetes.io/projected/8c128f70-8b95-453e-84d1-03769c16daa1-kube-api-access-gd2xp\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.328202 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.328064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c128f70-8b95-453e-84d1-03769c16daa1-webhook-cert\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.328202 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.328103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c128f70-8b95-453e-84d1-03769c16daa1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.328202 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.328131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c128f70-8b95-453e-84d1-03769c16daa1-tmp\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.328517 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.328482 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c128f70-8b95-453e-84d1-03769c16daa1-manifests\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.330679 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.330651 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c128f70-8b95-453e-84d1-03769c16daa1-tmp\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.330936 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.330916 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c128f70-8b95-453e-84d1-03769c16daa1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.331002 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.330980 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c128f70-8b95-453e-84d1-03769c16daa1-webhook-cert\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.349881 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.349859 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2xp\" (UniqueName: \"kubernetes.io/projected/8c128f70-8b95-453e-84d1-03769c16daa1-kube-api-access-gd2xp\") pod \"opendatahub-operator-controller-manager-f54898884-n9jn2\" (UID: \"8c128f70-8b95-453e-84d1-03769c16daa1\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.525114 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.525027 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:50.660584 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:50.660554 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2"] Jun 11 16:52:50.664669 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:52:50.664642 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c128f70_8b95_453e_84d1_03769c16daa1.slice/crio-063e418653ca8b57290c37da6be4f1e3dfca093498d5d00f8c7462d42d254b76 WatchSource:0}: Error finding container 063e418653ca8b57290c37da6be4f1e3dfca093498d5d00f8c7462d42d254b76: Status 404 returned error can't find the container with id 063e418653ca8b57290c37da6be4f1e3dfca093498d5d00f8c7462d42d254b76 Jun 11 16:52:51.344422 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:51.344374 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" event={"ID":"8c128f70-8b95-453e-84d1-03769c16daa1","Type":"ContainerStarted","Data":"063e418653ca8b57290c37da6be4f1e3dfca093498d5d00f8c7462d42d254b76"} Jun 11 16:52:54.358880 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:54.358845 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" event={"ID":"8c128f70-8b95-453e-84d1-03769c16daa1","Type":"ContainerStarted","Data":"f43e071dee6c23edd9b0a80c3f45d6f6a4322e709d7afe9048ac9a8738cd8047"} Jun 11 16:52:55.365078 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:55.365043 2580 generic.go:356] "Generic (PLEG): container finished" podID="8c128f70-8b95-453e-84d1-03769c16daa1" containerID="f43e071dee6c23edd9b0a80c3f45d6f6a4322e709d7afe9048ac9a8738cd8047" exitCode=0 Jun 11 16:52:55.365486 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:55.365118 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" event={"ID":"8c128f70-8b95-453e-84d1-03769c16daa1","Type":"ContainerDied","Data":"f43e071dee6c23edd9b0a80c3f45d6f6a4322e709d7afe9048ac9a8738cd8047"} Jun 11 16:52:56.371741 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:56.371699 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" event={"ID":"8c128f70-8b95-453e-84d1-03769c16daa1","Type":"ContainerStarted","Data":"315e52dee3b495fc27744bba5a91ea94c9f67c95e8dc198c42bcb51376fce3a7"} Jun 11 16:52:56.372212 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:56.371824 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:52:56.414600 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:52:56.414551 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" podStartSLOduration=2.357524755 podStartE2EDuration="6.414535468s" totalImagesPullingTime="3.089626358s" totalInitContainerRuntime="967.384355ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:56.413675078 +0000 UTC m=+529.392150606" watchObservedRunningTime="2026-06-11 16:52:56.414535468 +0000 UTC m=+529.393010998" Jun 11 16:53:07.377609 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:07.377576 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-n9jn2" Jun 11 16:53:10.891163 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:10.891127 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b9974d87-tr279"] Jun 11 16:53:10.901067 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:10.901041 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:10.907526 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:10.907504 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 16:53:10.908030 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:10.908013 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6g97g\"" Jun 11 16:53:10.911636 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:10.911611 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 16:53:10.913291 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:10.913273 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 16:53:10.921704 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:10.921679 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b9974d87-tr279"] Jun 11 16:53:10.987017 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:10.986984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c42f7ef-c294-4121-9713-cd6605c9adbf-cert\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:10.987184 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:10.987037 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c42f7ef-c294-4121-9713-cd6605c9adbf-manager-config\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:10.987184 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:10.987065 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c42f7ef-c294-4121-9713-cd6605c9adbf-metrics-cert\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:10.987184 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:10.987104 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65hfg\" (UniqueName: \"kubernetes.io/projected/9c42f7ef-c294-4121-9713-cd6605c9adbf-kube-api-access-65hfg\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:11.087831 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:11.087793 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c42f7ef-c294-4121-9713-cd6605c9adbf-manager-config\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:11.088025 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:11.087843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c42f7ef-c294-4121-9713-cd6605c9adbf-metrics-cert\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:11.088025 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:11.087971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65hfg\" (UniqueName: \"kubernetes.io/projected/9c42f7ef-c294-4121-9713-cd6605c9adbf-kube-api-access-65hfg\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:11.088025 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:11.088020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c42f7ef-c294-4121-9713-cd6605c9adbf-cert\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:11.088491 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:11.088471 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c42f7ef-c294-4121-9713-cd6605c9adbf-manager-config\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:11.090509 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:11.090488 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c42f7ef-c294-4121-9713-cd6605c9adbf-cert\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:11.090584 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:11.090493 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c42f7ef-c294-4121-9713-cd6605c9adbf-metrics-cert\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:11.111752 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:11.111727 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65hfg\" (UniqueName: \"kubernetes.io/projected/9c42f7ef-c294-4121-9713-cd6605c9adbf-kube-api-access-65hfg\") pod \"lws-controller-manager-57b9974d87-tr279\" (UID: \"9c42f7ef-c294-4121-9713-cd6605c9adbf\") " pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:11.212512 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:11.212411 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:11.385614 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:11.385577 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b9974d87-tr279"] Jun 11 16:53:11.388286 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:53:11.388243 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c42f7ef_c294_4121_9713_cd6605c9adbf.slice/crio-f26761b5bc6d8864ca5dc72290110bef5c7604afee7747c6e2955d7aefc7e222 WatchSource:0}: Error finding container f26761b5bc6d8864ca5dc72290110bef5c7604afee7747c6e2955d7aefc7e222: Status 404 returned error can't find the container with id f26761b5bc6d8864ca5dc72290110bef5c7604afee7747c6e2955d7aefc7e222 Jun 11 16:53:11.439503 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:11.439469 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" event={"ID":"9c42f7ef-c294-4121-9713-cd6605c9adbf","Type":"ContainerStarted","Data":"f26761b5bc6d8864ca5dc72290110bef5c7604afee7747c6e2955d7aefc7e222"} Jun 11 16:53:13.450807 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:13.450771 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" event={"ID":"9c42f7ef-c294-4121-9713-cd6605c9adbf","Type":"ContainerStarted","Data":"8eeea621734883259939aa836f1e6b5a66c83e031bfcf182355efafa63ff4d6c"} Jun 11 16:53:13.451270 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:13.450892 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:13.478678 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:13.478627 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" podStartSLOduration=1.786071856 podStartE2EDuration="3.478610795s" totalImagesPullingTime="1.692538939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:13.477824553 +0000 UTC m=+546.456300095" watchObservedRunningTime="2026-06-11 16:53:13.478610795 +0000 UTC m=+546.457086324" Jun 11 16:53:16.327088 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.327047 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67"] Jun 11 16:53:16.330631 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.330615 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:16.333438 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.333417 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h7k7\"" Jun 11 16:53:16.333583 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.333439 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:53:16.333583 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.333443 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:53:16.346001 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.345976 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67"] Jun 11 16:53:16.430831 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.430794 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j257j\" (UniqueName: \"kubernetes.io/projected/ba709263-7250-48bf-aa25-52f0adf6738b-kube-api-access-j257j\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:16.431001 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.430916 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:16.431001 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.430945 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:16.531893 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.531858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j257j\" (UniqueName: \"kubernetes.io/projected/ba709263-7250-48bf-aa25-52f0adf6738b-kube-api-access-j257j\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:16.532056 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.531941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:16.532056 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.531961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:16.532378 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.532357 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:16.532413 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.532369 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:16.541563 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.541538 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j257j\" (UniqueName: \"kubernetes.io/projected/ba709263-7250-48bf-aa25-52f0adf6738b-kube-api-access-j257j\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:16.639445 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.639417 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:16.774894 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:16.774871 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67"] Jun 11 16:53:16.777508 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:53:16.777482 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba709263_7250_48bf_aa25_52f0adf6738b.slice/crio-b779043540ec22da06d6a7ef4cb2677c0b2722fd9cb23dc10e3feb68122b5f7f WatchSource:0}: Error finding container b779043540ec22da06d6a7ef4cb2677c0b2722fd9cb23dc10e3feb68122b5f7f: Status 404 returned error can't find the container with id b779043540ec22da06d6a7ef4cb2677c0b2722fd9cb23dc10e3feb68122b5f7f Jun 11 16:53:17.469383 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:17.469350 2580 generic.go:356] "Generic (PLEG): container finished" podID="ba709263-7250-48bf-aa25-52f0adf6738b" containerID="f2cd21d4d48a6e425d7f2dcc5996de21b3a232ddfedb50926d71849b09aafcf6" exitCode=0 Jun 11 16:53:17.469782 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:17.469395 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" event={"ID":"ba709263-7250-48bf-aa25-52f0adf6738b","Type":"ContainerDied","Data":"f2cd21d4d48a6e425d7f2dcc5996de21b3a232ddfedb50926d71849b09aafcf6"} Jun 11 16:53:17.469782 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:17.469431 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" event={"ID":"ba709263-7250-48bf-aa25-52f0adf6738b","Type":"ContainerStarted","Data":"b779043540ec22da06d6a7ef4cb2677c0b2722fd9cb23dc10e3feb68122b5f7f"} Jun 11 16:53:18.476119 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:18.476089 2580 generic.go:356] "Generic (PLEG): container finished" podID="ba709263-7250-48bf-aa25-52f0adf6738b" containerID="400abd5cf37616086943e537ad6043c4eacfa818641dfd62ea50f98ea1b2dbac" exitCode=0 Jun 11 16:53:18.476532 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:18.476173 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" event={"ID":"ba709263-7250-48bf-aa25-52f0adf6738b","Type":"ContainerDied","Data":"400abd5cf37616086943e537ad6043c4eacfa818641dfd62ea50f98ea1b2dbac"} Jun 11 16:53:19.482698 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:19.482666 2580 generic.go:356] "Generic (PLEG): container finished" podID="ba709263-7250-48bf-aa25-52f0adf6738b" containerID="401ec1cf5471e16af5738012b9e8c5049c822bea14f46c731ef7c49e28876015" exitCode=0 Jun 11 16:53:19.483078 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:19.482715 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" event={"ID":"ba709263-7250-48bf-aa25-52f0adf6738b","Type":"ContainerDied","Data":"401ec1cf5471e16af5738012b9e8c5049c822bea14f46c731ef7c49e28876015"} Jun 11 16:53:20.617374 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:20.617351 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:20.766161 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:20.766057 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j257j\" (UniqueName: \"kubernetes.io/projected/ba709263-7250-48bf-aa25-52f0adf6738b-kube-api-access-j257j\") pod \"ba709263-7250-48bf-aa25-52f0adf6738b\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " Jun 11 16:53:20.766161 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:20.766113 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-util\") pod \"ba709263-7250-48bf-aa25-52f0adf6738b\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " Jun 11 16:53:20.766334 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:20.766199 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-bundle\") pod \"ba709263-7250-48bf-aa25-52f0adf6738b\" (UID: \"ba709263-7250-48bf-aa25-52f0adf6738b\") " Jun 11 16:53:20.767255 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:20.767225 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-bundle" (OuterVolumeSpecName: "bundle") pod "ba709263-7250-48bf-aa25-52f0adf6738b" (UID: "ba709263-7250-48bf-aa25-52f0adf6738b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:53:20.768336 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:20.768315 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba709263-7250-48bf-aa25-52f0adf6738b-kube-api-access-j257j" (OuterVolumeSpecName: "kube-api-access-j257j") pod "ba709263-7250-48bf-aa25-52f0adf6738b" (UID: "ba709263-7250-48bf-aa25-52f0adf6738b"). InnerVolumeSpecName "kube-api-access-j257j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:53:20.772009 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:20.771989 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-util" (OuterVolumeSpecName: "util") pod "ba709263-7250-48bf-aa25-52f0adf6738b" (UID: "ba709263-7250-48bf-aa25-52f0adf6738b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:53:20.866987 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:20.866948 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-bundle\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:53:20.866987 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:20.866979 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j257j\" (UniqueName: \"kubernetes.io/projected/ba709263-7250-48bf-aa25-52f0adf6738b-kube-api-access-j257j\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:53:20.866987 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:20.866994 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba709263-7250-48bf-aa25-52f0adf6738b-util\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:53:21.493203 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:21.493178 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" Jun 11 16:53:21.493203 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:21.493198 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vps67" event={"ID":"ba709263-7250-48bf-aa25-52f0adf6738b","Type":"ContainerDied","Data":"b779043540ec22da06d6a7ef4cb2677c0b2722fd9cb23dc10e3feb68122b5f7f"} Jun 11 16:53:21.493523 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:21.493247 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b779043540ec22da06d6a7ef4cb2677c0b2722fd9cb23dc10e3feb68122b5f7f" Jun 11 16:53:24.456731 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:24.456705 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57b9974d87-tr279" Jun 11 16:53:30.783244 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.783212 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg"] Jun 11 16:53:30.783747 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.783507 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba709263-7250-48bf-aa25-52f0adf6738b" containerName="extract" Jun 11 16:53:30.783747 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.783518 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba709263-7250-48bf-aa25-52f0adf6738b" containerName="extract" Jun 11 16:53:30.783747 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.783529 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba709263-7250-48bf-aa25-52f0adf6738b" containerName="pull" Jun 11 16:53:30.783747 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.783534 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba709263-7250-48bf-aa25-52f0adf6738b" containerName="pull" Jun 11 16:53:30.783747 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.783544 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba709263-7250-48bf-aa25-52f0adf6738b" containerName="util" Jun 11 16:53:30.783747 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.783549 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba709263-7250-48bf-aa25-52f0adf6738b" containerName="util" Jun 11 16:53:30.783747 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.783608 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba709263-7250-48bf-aa25-52f0adf6738b" containerName="extract" Jun 11 16:53:30.791911 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.791891 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:30.807722 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.807700 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:53:30.807722 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.807717 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h7k7\"" Jun 11 16:53:30.807879 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.807750 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:53:30.816844 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.816825 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg"] Jun 11 16:53:30.950250 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.950212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:30.950426 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.950273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqhnq\" (UniqueName: \"kubernetes.io/projected/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-kube-api-access-kqhnq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:30.950426 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:30.950319 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:31.051584 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:31.051488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:31.051892 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:31.051851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:31.052007 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:31.051923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqhnq\" (UniqueName: \"kubernetes.io/projected/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-kube-api-access-kqhnq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:31.052082 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:31.052024 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:31.052184 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:31.052160 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:31.092276 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:31.092239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqhnq\" (UniqueName: \"kubernetes.io/projected/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-kube-api-access-kqhnq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:31.101053 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:31.101032 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:31.391393 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:31.391363 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg"] Jun 11 16:53:31.392378 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:53:31.392348 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915a3d6a_c9c3_4996_b869_7e0cb0e4dd9b.slice/crio-9da818d2a75aa8cc08a7e4615ef6a19dd1ee025b5cc5843d1345596fd3688a13 WatchSource:0}: Error finding container 9da818d2a75aa8cc08a7e4615ef6a19dd1ee025b5cc5843d1345596fd3688a13: Status 404 returned error can't find the container with id 9da818d2a75aa8cc08a7e4615ef6a19dd1ee025b5cc5843d1345596fd3688a13 Jun 11 16:53:31.537963 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:31.537923 2580 generic.go:356] "Generic (PLEG): container finished" podID="915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" containerID="d7752a9268fcaf30bd62f83c9c39f369463046a43dffcface1f5bb52db1090de" exitCode=0 Jun 11 16:53:31.538119 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:31.537997 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" event={"ID":"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b","Type":"ContainerDied","Data":"d7752a9268fcaf30bd62f83c9c39f369463046a43dffcface1f5bb52db1090de"} Jun 11 16:53:31.538119 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:31.538061 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" event={"ID":"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b","Type":"ContainerStarted","Data":"9da818d2a75aa8cc08a7e4615ef6a19dd1ee025b5cc5843d1345596fd3688a13"} Jun 11 16:53:32.545185 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:32.545145 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" event={"ID":"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b","Type":"ContainerStarted","Data":"b211bc5efd5945743107c8562421039ba80d5e111d11943dbb8de26b74c98449"} Jun 11 16:53:33.486029 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.485995 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6879556547-5kjm6"] Jun 11 16:53:33.489250 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.489227 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6879556547-5kjm6" Jun 11 16:53:33.497333 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.497313 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 16:53:33.497475 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.497441 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t59l5\"" Jun 11 16:53:33.511947 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.511923 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6879556547-5kjm6"] Jun 11 16:53:33.551345 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.551322 2580 generic.go:356] "Generic (PLEG): container finished" podID="915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" containerID="b211bc5efd5945743107c8562421039ba80d5e111d11943dbb8de26b74c98449" exitCode=0 Jun 11 16:53:33.551738 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.551355 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" event={"ID":"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b","Type":"ContainerDied","Data":"b211bc5efd5945743107c8562421039ba80d5e111d11943dbb8de26b74c98449"} Jun 11 16:53:33.576270 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.576238 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a654fc02-c562-4021-a93b-2aa0d016d2e9-redirect-config\") pod \"dashboard-redirect-6879556547-5kjm6\" (UID: \"a654fc02-c562-4021-a93b-2aa0d016d2e9\") " pod="opendatahub/dashboard-redirect-6879556547-5kjm6" Jun 11 16:53:33.576359 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.576297 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsqbm\" (UniqueName: \"kubernetes.io/projected/a654fc02-c562-4021-a93b-2aa0d016d2e9-kube-api-access-xsqbm\") pod \"dashboard-redirect-6879556547-5kjm6\" (UID: \"a654fc02-c562-4021-a93b-2aa0d016d2e9\") " pod="opendatahub/dashboard-redirect-6879556547-5kjm6" Jun 11 16:53:33.677320 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.677286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a654fc02-c562-4021-a93b-2aa0d016d2e9-redirect-config\") pod \"dashboard-redirect-6879556547-5kjm6\" (UID: \"a654fc02-c562-4021-a93b-2aa0d016d2e9\") " pod="opendatahub/dashboard-redirect-6879556547-5kjm6" Jun 11 16:53:33.677514 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.677339 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsqbm\" (UniqueName: \"kubernetes.io/projected/a654fc02-c562-4021-a93b-2aa0d016d2e9-kube-api-access-xsqbm\") pod \"dashboard-redirect-6879556547-5kjm6\" (UID: \"a654fc02-c562-4021-a93b-2aa0d016d2e9\") " pod="opendatahub/dashboard-redirect-6879556547-5kjm6" Jun 11 16:53:33.678153 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.678132 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a654fc02-c562-4021-a93b-2aa0d016d2e9-redirect-config\") pod \"dashboard-redirect-6879556547-5kjm6\" (UID: \"a654fc02-c562-4021-a93b-2aa0d016d2e9\") " pod="opendatahub/dashboard-redirect-6879556547-5kjm6" Jun 11 16:53:33.690644 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.690616 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsqbm\" (UniqueName: \"kubernetes.io/projected/a654fc02-c562-4021-a93b-2aa0d016d2e9-kube-api-access-xsqbm\") pod \"dashboard-redirect-6879556547-5kjm6\" (UID: \"a654fc02-c562-4021-a93b-2aa0d016d2e9\") " pod="opendatahub/dashboard-redirect-6879556547-5kjm6" Jun 11 16:53:33.798971 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.798948 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6879556547-5kjm6" Jun 11 16:53:33.944134 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:33.944040 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6879556547-5kjm6"] Jun 11 16:53:33.948716 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:53:33.948684 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda654fc02_c562_4021_a93b_2aa0d016d2e9.slice/crio-437b35f8be2836745d30a0548af95b98d9c0299b58c7185c92d2a6feb3082f4e WatchSource:0}: Error finding container 437b35f8be2836745d30a0548af95b98d9c0299b58c7185c92d2a6feb3082f4e: Status 404 returned error can't find the container with id 437b35f8be2836745d30a0548af95b98d9c0299b58c7185c92d2a6feb3082f4e Jun 11 16:53:34.556514 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:34.556476 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6879556547-5kjm6" event={"ID":"a654fc02-c562-4021-a93b-2aa0d016d2e9","Type":"ContainerStarted","Data":"437b35f8be2836745d30a0548af95b98d9c0299b58c7185c92d2a6feb3082f4e"} Jun 11 16:53:34.558374 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:34.558346 2580 generic.go:356] "Generic (PLEG): container finished" podID="915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" containerID="f4d40b8a71b3e9deaece76e693acbdb44b0fe99a903ee19a481756ce32d95401" exitCode=0 Jun 11 16:53:34.558515 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:34.558403 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" event={"ID":"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b","Type":"ContainerDied","Data":"f4d40b8a71b3e9deaece76e693acbdb44b0fe99a903ee19a481756ce32d95401"} Jun 11 16:53:35.690122 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:35.690095 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:35.797513 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:35.797482 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-util\") pod \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " Jun 11 16:53:35.797666 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:35.797541 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqhnq\" (UniqueName: \"kubernetes.io/projected/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-kube-api-access-kqhnq\") pod \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " Jun 11 16:53:35.797666 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:35.797579 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-bundle\") pod \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\" (UID: \"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b\") " Jun 11 16:53:35.798494 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:35.798432 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-bundle" (OuterVolumeSpecName: "bundle") pod "915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" (UID: "915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:53:35.799819 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:35.799799 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-kube-api-access-kqhnq" (OuterVolumeSpecName: "kube-api-access-kqhnq") pod "915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" (UID: "915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b"). InnerVolumeSpecName "kube-api-access-kqhnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:53:35.805579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:35.805539 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-util" (OuterVolumeSpecName: "util") pod "915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" (UID: "915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:53:35.898546 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:35.898520 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-bundle\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:53:35.898546 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:35.898545 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-util\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:53:35.898710 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:35.898553 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqhnq\" (UniqueName: \"kubernetes.io/projected/915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b-kube-api-access-kqhnq\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:53:36.570156 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:36.570130 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" Jun 11 16:53:36.570314 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:36.570162 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ag9thg" event={"ID":"915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b","Type":"ContainerDied","Data":"9da818d2a75aa8cc08a7e4615ef6a19dd1ee025b5cc5843d1345596fd3688a13"} Jun 11 16:53:36.570314 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:36.570208 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9da818d2a75aa8cc08a7e4615ef6a19dd1ee025b5cc5843d1345596fd3688a13" Jun 11 16:53:42.604628 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:42.604587 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6879556547-5kjm6" event={"ID":"a654fc02-c562-4021-a93b-2aa0d016d2e9","Type":"ContainerStarted","Data":"f81c06792eca9cd88674f72577f27924b44accc1fa96cdff3f04bb767232cae6"} Jun 11 16:53:42.621264 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:42.621206 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6879556547-5kjm6" podStartSLOduration=1.760889828 podStartE2EDuration="9.621191127s" totalImagesPullingTime="7.860301299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:42.620322313 +0000 UTC m=+575.598797842" watchObservedRunningTime="2026-06-11 16:53:42.621191127 +0000 UTC m=+575.599666656" Jun 11 16:53:50.585087 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.585056 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf"] Jun 11 16:53:50.585460 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.585342 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" containerName="pull" Jun 11 16:53:50.585460 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.585352 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" containerName="pull" Jun 11 16:53:50.585460 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.585361 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" containerName="extract" Jun 11 16:53:50.585460 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.585366 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" containerName="extract" Jun 11 16:53:50.585460 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.585375 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" containerName="util" Jun 11 16:53:50.585460 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.585381 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" containerName="util" Jun 11 16:53:50.585460 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.585434 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="915a3d6a-c9c3-4996-b869-7e0cb0e4dd9b" containerName="extract" Jun 11 16:53:50.588278 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.588251 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.590909 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.590885 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7rg92\"" Jun 11 16:53:50.591509 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.591486 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 16:53:50.591509 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.591499 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 16:53:50.591757 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.591742 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 16:53:50.603243 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.603218 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf"] Jun 11 16:53:50.622756 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.622727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4rgj\" (UniqueName: \"kubernetes.io/projected/18220b0b-b691-403a-9493-eaa632bcbe6e-kube-api-access-r4rgj\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.622871 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.622773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.622871 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.622803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.622871 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.622855 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18220b0b-b691-403a-9493-eaa632bcbe6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.623027 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.622881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.623027 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.622915 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.623027 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.622939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.623027 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.622991 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.623027 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.623015 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.723896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.723859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.723896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.723897 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724130 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.723923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4rgj\" (UniqueName: \"kubernetes.io/projected/18220b0b-b691-403a-9493-eaa632bcbe6e-kube-api-access-r4rgj\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724130 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.723955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724130 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.723983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724130 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.724026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18220b0b-b691-403a-9493-eaa632bcbe6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724130 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.724054 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724380 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.724180 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724380 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.724235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724380 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.724350 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724563 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.724507 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724615 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.724575 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724670 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.724609 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.724833 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.724815 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18220b0b-b691-403a-9493-eaa632bcbe6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.726566 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.726543 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.726660 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.726604 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.732861 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.732837 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18220b0b-b691-403a-9493-eaa632bcbe6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.734092 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.734060 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4rgj\" (UniqueName: \"kubernetes.io/projected/18220b0b-b691-403a-9493-eaa632bcbe6e-kube-api-access-r4rgj\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mhgjf\" (UID: \"18220b0b-b691-403a-9493-eaa632bcbe6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:50.898187 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:50.898153 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:51.039850 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:51.039822 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf"] Jun 11 16:53:51.041797 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:53:51.041764 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18220b0b_b691_403a_9493_eaa632bcbe6e.slice/crio-00c2a22cef245edf020d3d7bd21bf092bf4547942eea5e7147e68f25ec3f6f9c WatchSource:0}: Error finding container 00c2a22cef245edf020d3d7bd21bf092bf4547942eea5e7147e68f25ec3f6f9c: Status 404 returned error can't find the container with id 00c2a22cef245edf020d3d7bd21bf092bf4547942eea5e7147e68f25ec3f6f9c Jun 11 16:53:51.643815 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:51.643776 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" event={"ID":"18220b0b-b691-403a-9493-eaa632bcbe6e","Type":"ContainerStarted","Data":"00c2a22cef245edf020d3d7bd21bf092bf4547942eea5e7147e68f25ec3f6f9c"} Jun 11 16:53:54.198115 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:54.198065 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:53:54.198528 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:54.198169 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:53:54.198528 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:54.198218 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:53:54.660775 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:54.660738 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" event={"ID":"18220b0b-b691-403a-9493-eaa632bcbe6e","Type":"ContainerStarted","Data":"090ddbe8d376492c63d7b899b326dc64d394d40e782dce772d1cd1d5e20798ad"} Jun 11 16:53:54.693013 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:54.692957 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" podStartSLOduration=1.5387799709999999 podStartE2EDuration="4.692939334s" totalImagesPullingTime="3.154159363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:54.691406492 +0000 UTC m=+587.669882024" watchObservedRunningTime="2026-06-11 16:53:54.692939334 +0000 UTC m=+587.671414863" Jun 11 16:53:54.898596 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:54.898559 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:55.903404 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:55.903373 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:56.670420 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:56.670389 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:53:56.671269 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:53:56.671250 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mhgjf" Jun 11 16:54:07.487373 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:07.487347 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 16:54:07.487842 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:07.487518 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 16:54:11.779991 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:11.779958 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zvkxk"] Jun 11 16:54:11.785926 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:11.785904 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" Jun 11 16:54:11.788617 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:11.788480 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:54:11.789132 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:11.789114 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:54:11.789226 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:11.789113 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-88ffj\"" Jun 11 16:54:11.794570 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:11.794265 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zvkxk"] Jun 11 16:54:11.895277 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:11.895238 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmgvx\" (UniqueName: \"kubernetes.io/projected/231bdb43-c9cd-43e5-97c1-c102c130602d-kube-api-access-hmgvx\") pod \"kuadrant-operator-catalog-zvkxk\" (UID: \"231bdb43-c9cd-43e5-97c1-c102c130602d\") " pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" Jun 11 16:54:11.996581 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:11.996549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmgvx\" (UniqueName: \"kubernetes.io/projected/231bdb43-c9cd-43e5-97c1-c102c130602d-kube-api-access-hmgvx\") pod \"kuadrant-operator-catalog-zvkxk\" (UID: \"231bdb43-c9cd-43e5-97c1-c102c130602d\") " pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" Jun 11 16:54:12.005649 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.005625 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmgvx\" (UniqueName: \"kubernetes.io/projected/231bdb43-c9cd-43e5-97c1-c102c130602d-kube-api-access-hmgvx\") pod \"kuadrant-operator-catalog-zvkxk\" (UID: \"231bdb43-c9cd-43e5-97c1-c102c130602d\") " pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" Jun 11 16:54:12.097395 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.097338 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" Jun 11 16:54:12.138692 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.138649 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zvkxk"] Jun 11 16:54:12.243272 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.243181 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zvkxk"] Jun 11 16:54:12.245493 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:54:12.245440 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231bdb43_c9cd_43e5_97c1_c102c130602d.slice/crio-01e06d320b6880a1078d2266b4c3e762995467ed0f0dc9526add180bb3d16cd5 WatchSource:0}: Error finding container 01e06d320b6880a1078d2266b4c3e762995467ed0f0dc9526add180bb3d16cd5: Status 404 returned error can't find the container with id 01e06d320b6880a1078d2266b4c3e762995467ed0f0dc9526add180bb3d16cd5 Jun 11 16:54:12.246997 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.246978 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:54:12.348158 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.348076 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rz6jj"] Jun 11 16:54:12.433295 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.433263 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rz6jj"] Jun 11 16:54:12.433486 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.433369 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" Jun 11 16:54:12.501156 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.501127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwzs\" (UniqueName: \"kubernetes.io/projected/7ad17bc1-7b58-4a83-acc7-578c8b1b94f0-kube-api-access-mgwzs\") pod \"kuadrant-operator-catalog-rz6jj\" (UID: \"7ad17bc1-7b58-4a83-acc7-578c8b1b94f0\") " pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" Jun 11 16:54:12.602434 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.602370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwzs\" (UniqueName: \"kubernetes.io/projected/7ad17bc1-7b58-4a83-acc7-578c8b1b94f0-kube-api-access-mgwzs\") pod \"kuadrant-operator-catalog-rz6jj\" (UID: \"7ad17bc1-7b58-4a83-acc7-578c8b1b94f0\") " pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" Jun 11 16:54:12.610971 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.610949 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwzs\" (UniqueName: \"kubernetes.io/projected/7ad17bc1-7b58-4a83-acc7-578c8b1b94f0-kube-api-access-mgwzs\") pod \"kuadrant-operator-catalog-rz6jj\" (UID: \"7ad17bc1-7b58-4a83-acc7-578c8b1b94f0\") " pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" Jun 11 16:54:12.742355 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.742323 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" Jun 11 16:54:12.748356 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.748328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" event={"ID":"231bdb43-c9cd-43e5-97c1-c102c130602d","Type":"ContainerStarted","Data":"01e06d320b6880a1078d2266b4c3e762995467ed0f0dc9526add180bb3d16cd5"} Jun 11 16:54:12.901682 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:12.901658 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rz6jj"] Jun 11 16:54:12.904208 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:54:12.904181 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad17bc1_7b58_4a83_acc7_578c8b1b94f0.slice/crio-4263df5e67fd80f357d65f161065a24be3b69977d3e8f7922180e16f7c86bfc9 WatchSource:0}: Error finding container 4263df5e67fd80f357d65f161065a24be3b69977d3e8f7922180e16f7c86bfc9: Status 404 returned error can't find the container with id 4263df5e67fd80f357d65f161065a24be3b69977d3e8f7922180e16f7c86bfc9 Jun 11 16:54:13.755257 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:13.755221 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" event={"ID":"7ad17bc1-7b58-4a83-acc7-578c8b1b94f0","Type":"ContainerStarted","Data":"4263df5e67fd80f357d65f161065a24be3b69977d3e8f7922180e16f7c86bfc9"} Jun 11 16:54:15.766757 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:15.766721 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" event={"ID":"7ad17bc1-7b58-4a83-acc7-578c8b1b94f0","Type":"ContainerStarted","Data":"528aafc19a82f832df2c0e8c08f5e39989a2afbdcb4fe2824fa21fce93feaacc"} Jun 11 16:54:15.768242 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:15.768215 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" event={"ID":"231bdb43-c9cd-43e5-97c1-c102c130602d","Type":"ContainerStarted","Data":"85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9"} Jun 11 16:54:15.768365 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:15.768309 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" podUID="231bdb43-c9cd-43e5-97c1-c102c130602d" containerName="registry-server" containerID="cri-o://85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9" gracePeriod=2 Jun 11 16:54:15.784149 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:15.784105 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" podStartSLOduration=1.8024166940000002 podStartE2EDuration="3.784090268s" totalImagesPullingTime="1.981673574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:15.782477688 +0000 UTC m=+608.760953219" watchObservedRunningTime="2026-06-11 16:54:15.784090268 +0000 UTC m=+608.762565797" Jun 11 16:54:15.799353 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:15.799308 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" podStartSLOduration=2.176479944 podStartE2EDuration="4.799292931s" totalImagesPullingTime="2.622812987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:15.79842842 +0000 UTC m=+608.776903949" watchObservedRunningTime="2026-06-11 16:54:15.799292931 +0000 UTC m=+608.777768459" Jun 11 16:54:16.011668 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.011636 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" Jun 11 16:54:16.135081 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.135047 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmgvx\" (UniqueName: \"kubernetes.io/projected/231bdb43-c9cd-43e5-97c1-c102c130602d-kube-api-access-hmgvx\") pod \"231bdb43-c9cd-43e5-97c1-c102c130602d\" (UID: \"231bdb43-c9cd-43e5-97c1-c102c130602d\") " Jun 11 16:54:16.137346 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.137325 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231bdb43-c9cd-43e5-97c1-c102c130602d-kube-api-access-hmgvx" (OuterVolumeSpecName: "kube-api-access-hmgvx") pod "231bdb43-c9cd-43e5-97c1-c102c130602d" (UID: "231bdb43-c9cd-43e5-97c1-c102c130602d"). InnerVolumeSpecName "kube-api-access-hmgvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:54:16.235899 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.235864 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmgvx\" (UniqueName: \"kubernetes.io/projected/231bdb43-c9cd-43e5-97c1-c102c130602d-kube-api-access-hmgvx\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:16.774117 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.774037 2580 generic.go:356] "Generic (PLEG): container finished" podID="231bdb43-c9cd-43e5-97c1-c102c130602d" containerID="85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9" exitCode=0 Jun 11 16:54:16.774117 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.774078 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" Jun 11 16:54:16.774579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.774120 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" event={"ID":"231bdb43-c9cd-43e5-97c1-c102c130602d","Type":"ContainerDied","Data":"85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9"} Jun 11 16:54:16.774579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.774171 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zvkxk" event={"ID":"231bdb43-c9cd-43e5-97c1-c102c130602d","Type":"ContainerDied","Data":"01e06d320b6880a1078d2266b4c3e762995467ed0f0dc9526add180bb3d16cd5"} Jun 11 16:54:16.774579 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.774198 2580 scope.go:117] "RemoveContainer" containerID="85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9" Jun 11 16:54:16.783176 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.783159 2580 scope.go:117] "RemoveContainer" containerID="85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9" Jun 11 16:54:16.783428 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:54:16.783409 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9\": container with ID starting with 85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9 not found: ID does not exist" containerID="85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9" Jun 11 16:54:16.783549 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.783437 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9"} err="failed to get container status \"85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9\": rpc error: code = NotFound desc = could not find container \"85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9\": container with ID starting with 85d3f4df5bf0010473ce78c107b23dbf6c53e226c7acac8df252314a8d0a30f9 not found: ID does not exist" Jun 11 16:54:16.798198 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.798170 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zvkxk"] Jun 11 16:54:16.803983 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:16.803956 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zvkxk"] Jun 11 16:54:17.522498 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:17.522466 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="231bdb43-c9cd-43e5-97c1-c102c130602d" path="/var/lib/kubelet/pods/231bdb43-c9cd-43e5-97c1-c102c130602d/volumes" Jun 11 16:54:22.743292 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:22.743254 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" Jun 11 16:54:22.743714 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:22.743324 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" Jun 11 16:54:22.765234 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:22.765210 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" Jun 11 16:54:22.827468 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:22.827418 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rz6jj" Jun 11 16:54:28.154827 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.154787 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-576d584b54-2s282"] Jun 11 16:54:28.155545 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.155240 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="231bdb43-c9cd-43e5-97c1-c102c130602d" containerName="registry-server" Jun 11 16:54:28.155545 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.155260 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="231bdb43-c9cd-43e5-97c1-c102c130602d" containerName="registry-server" Jun 11 16:54:28.155545 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.155389 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="231bdb43-c9cd-43e5-97c1-c102c130602d" containerName="registry-server" Jun 11 16:54:28.163166 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.163144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.165743 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.165720 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 16:54:28.166292 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.166271 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 16:54:28.166292 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.166286 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 16:54:28.166429 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.166291 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 16:54:28.166542 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.166528 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 16:54:28.166605 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.166557 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 16:54:28.166810 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.166792 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 16:54:28.166888 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.166798 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fvk45\"" Jun 11 16:54:28.171437 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.171116 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576d584b54-2s282"] Jun 11 16:54:28.174230 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.174211 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 16:54:28.231836 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.231809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-console-config\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.231953 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.231840 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a966bdaf-1dad-47a7-a728-898239f297c1-console-oauth-config\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.231953 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.231859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-oauth-serving-cert\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.231953 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.231878 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-service-ca\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.232059 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.231956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c48s\" (UniqueName: \"kubernetes.io/projected/a966bdaf-1dad-47a7-a728-898239f297c1-kube-api-access-5c48s\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.232059 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.232012 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-trusted-ca-bundle\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.232119 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.232057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a966bdaf-1dad-47a7-a728-898239f297c1-console-serving-cert\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.333211 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.333181 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a966bdaf-1dad-47a7-a728-898239f297c1-console-oauth-config\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.333211 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.333213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-oauth-serving-cert\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.333403 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.333237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-service-ca\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.333403 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.333267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c48s\" (UniqueName: \"kubernetes.io/projected/a966bdaf-1dad-47a7-a728-898239f297c1-kube-api-access-5c48s\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.333403 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.333314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-trusted-ca-bundle\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.333403 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.333348 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a966bdaf-1dad-47a7-a728-898239f297c1-console-serving-cert\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.333403 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.333398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-console-config\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.334094 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.334067 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-service-ca\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.334204 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.334155 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-console-config\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.334204 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.334154 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-oauth-serving-cert\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.334323 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.334218 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a966bdaf-1dad-47a7-a728-898239f297c1-trusted-ca-bundle\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.335804 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.335785 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a966bdaf-1dad-47a7-a728-898239f297c1-console-oauth-config\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.335918 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.335900 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a966bdaf-1dad-47a7-a728-898239f297c1-console-serving-cert\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.342223 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.342199 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c48s\" (UniqueName: \"kubernetes.io/projected/a966bdaf-1dad-47a7-a728-898239f297c1-kube-api-access-5c48s\") pod \"console-576d584b54-2s282\" (UID: \"a966bdaf-1dad-47a7-a728-898239f297c1\") " pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.474185 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.474100 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:28.607099 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.607075 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576d584b54-2s282"] Jun 11 16:54:28.609383 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:54:28.609357 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda966bdaf_1dad_47a7_a728_898239f297c1.slice/crio-0a72ba561f79ff3f43aadcac677a73a548f9278bc8fa0577de320d3d81970bb4 WatchSource:0}: Error finding container 0a72ba561f79ff3f43aadcac677a73a548f9278bc8fa0577de320d3d81970bb4: Status 404 returned error can't find the container with id 0a72ba561f79ff3f43aadcac677a73a548f9278bc8fa0577de320d3d81970bb4 Jun 11 16:54:28.839242 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.839147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576d584b54-2s282" event={"ID":"a966bdaf-1dad-47a7-a728-898239f297c1","Type":"ContainerStarted","Data":"442acdfa474bd96ec7fc4273c2192625c7f4158658597ac538350274b0396741"} Jun 11 16:54:28.839242 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.839208 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576d584b54-2s282" event={"ID":"a966bdaf-1dad-47a7-a728-898239f297c1","Type":"ContainerStarted","Data":"0a72ba561f79ff3f43aadcac677a73a548f9278bc8fa0577de320d3d81970bb4"} Jun 11 16:54:28.861488 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:28.861417 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-576d584b54-2s282" podStartSLOduration=0.861404138 podStartE2EDuration="861.404138ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:28.859800644 +0000 UTC m=+621.838276196" watchObservedRunningTime="2026-06-11 16:54:28.861404138 +0000 UTC m=+621.839879666" Jun 11 16:54:30.154709 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.154678 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh"] Jun 11 16:54:30.158240 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.158224 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:30.160856 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.160835 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qfjql\"" Jun 11 16:54:30.166970 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.166948 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh"] Jun 11 16:54:30.249404 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.249364 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:30.249674 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.249479 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:30.249674 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.249526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqn2p\" (UniqueName: \"kubernetes.io/projected/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-kube-api-access-gqn2p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:30.252725 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.252695 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj"] Jun 11 16:54:30.256063 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.256047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:30.271269 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.271245 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj"] Jun 11 16:54:30.350857 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.350828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:30.351044 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.350864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nrkw\" (UniqueName: \"kubernetes.io/projected/722101c5-4f4f-465d-b9dd-166004a3ef4c-kube-api-access-2nrkw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:30.351044 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.350895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:30.351044 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.350925 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqn2p\" (UniqueName: \"kubernetes.io/projected/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-kube-api-access-gqn2p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:30.351044 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.350954 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:30.351044 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.350981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:30.351323 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.351300 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:30.351372 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.351328 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:30.359402 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.359375 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqn2p\" (UniqueName: \"kubernetes.io/projected/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-kube-api-access-gqn2p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:30.451521 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.451401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:30.451521 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.451438 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nrkw\" (UniqueName: \"kubernetes.io/projected/722101c5-4f4f-465d-b9dd-166004a3ef4c-kube-api-access-2nrkw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:30.451521 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.451510 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:30.451866 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.451844 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:30.451927 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.451871 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:30.459824 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.459794 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nrkw\" (UniqueName: \"kubernetes.io/projected/722101c5-4f4f-465d-b9dd-166004a3ef4c-kube-api-access-2nrkw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:30.468482 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.468443 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:30.548309 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.548013 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq"] Jun 11 16:54:30.554191 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.554165 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:30.564721 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.564652 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq"] Jun 11 16:54:30.564721 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.564715 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:30.605492 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.605467 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh"] Jun 11 16:54:30.652554 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.652523 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:30.652697 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.652580 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:30.652697 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.652618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72vtm\" (UniqueName: \"kubernetes.io/projected/4be8a280-e763-406e-9fdf-15aed9cacbd7-kube-api-access-72vtm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:30.712062 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.712034 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj"] Jun 11 16:54:30.714379 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:54:30.714353 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722101c5_4f4f_465d_b9dd_166004a3ef4c.slice/crio-42d56b27f13483c09e5ff66d5b1a61f6e231e0512a2132c075ce9c191d13700a WatchSource:0}: Error finding container 42d56b27f13483c09e5ff66d5b1a61f6e231e0512a2132c075ce9c191d13700a: Status 404 returned error can't find the container with id 42d56b27f13483c09e5ff66d5b1a61f6e231e0512a2132c075ce9c191d13700a Jun 11 16:54:30.753175 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.753146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:30.753281 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.753195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:30.753281 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.753220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72vtm\" (UniqueName: \"kubernetes.io/projected/4be8a280-e763-406e-9fdf-15aed9cacbd7-kube-api-access-72vtm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:30.753527 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.753508 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:30.753569 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.753551 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:30.761844 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.761820 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72vtm\" (UniqueName: \"kubernetes.io/projected/4be8a280-e763-406e-9fdf-15aed9cacbd7-kube-api-access-72vtm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:30.851515 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.851484 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" event={"ID":"722101c5-4f4f-465d-b9dd-166004a3ef4c","Type":"ContainerStarted","Data":"15c6ea44b4423a2b7db3a44c1613563d31b04a1322bf926495c74d3441a876c3"} Jun 11 16:54:30.851690 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.851543 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" event={"ID":"722101c5-4f4f-465d-b9dd-166004a3ef4c","Type":"ContainerStarted","Data":"42d56b27f13483c09e5ff66d5b1a61f6e231e0512a2132c075ce9c191d13700a"} Jun 11 16:54:30.853123 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.853090 2580 generic.go:356] "Generic (PLEG): container finished" podID="5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" containerID="80a9d969804ac01aa42a166edbad4b0b08d32effb6e12f7cd2511a6b8f2b0d9d" exitCode=0 Jun 11 16:54:30.853219 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.853144 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" event={"ID":"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5","Type":"ContainerDied","Data":"80a9d969804ac01aa42a166edbad4b0b08d32effb6e12f7cd2511a6b8f2b0d9d"} Jun 11 16:54:30.853219 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.853189 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" event={"ID":"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5","Type":"ContainerStarted","Data":"540238a593f02d6b2ddb48a6a8082b1a25119afb9c503ea6d9fa405726e2056c"} Jun 11 16:54:30.866199 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.866178 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:30.952943 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.952692 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4"] Jun 11 16:54:30.956778 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.956761 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:30.967380 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:30.967356 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4"] Jun 11 16:54:31.014556 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.014519 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq"] Jun 11 16:54:31.018918 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:54:31.018895 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be8a280_e763_406e_9fdf_15aed9cacbd7.slice/crio-22ddf9051fe7e9669bfe02469a5dc2b8137518a40baf462b28ac1e9ce4ffbdf3 WatchSource:0}: Error finding container 22ddf9051fe7e9669bfe02469a5dc2b8137518a40baf462b28ac1e9ce4ffbdf3: Status 404 returned error can't find the container with id 22ddf9051fe7e9669bfe02469a5dc2b8137518a40baf462b28ac1e9ce4ffbdf3 Jun 11 16:54:31.056311 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.056271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8smv\" (UniqueName: \"kubernetes.io/projected/d64550a0-5c48-4803-9de3-36c77f8576ea-kube-api-access-k8smv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:31.056415 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.056359 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:31.056539 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.056441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:31.157158 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.157128 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:31.157627 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.157179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:31.157627 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.157209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8smv\" (UniqueName: \"kubernetes.io/projected/d64550a0-5c48-4803-9de3-36c77f8576ea-kube-api-access-k8smv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:31.157732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.157632 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:31.157732 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.157639 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:31.166481 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.166435 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8smv\" (UniqueName: \"kubernetes.io/projected/d64550a0-5c48-4803-9de3-36c77f8576ea-kube-api-access-k8smv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:31.268042 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.267951 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:31.401237 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.401212 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4"] Jun 11 16:54:31.403236 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:54:31.403210 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64550a0_5c48_4803_9de3_36c77f8576ea.slice/crio-5208e7500026293e37c415147ee26941e137a6dc4fb551f1dba041a418042aca WatchSource:0}: Error finding container 5208e7500026293e37c415147ee26941e137a6dc4fb551f1dba041a418042aca: Status 404 returned error can't find the container with id 5208e7500026293e37c415147ee26941e137a6dc4fb551f1dba041a418042aca Jun 11 16:54:31.859525 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.859494 2580 generic.go:356] "Generic (PLEG): container finished" podID="722101c5-4f4f-465d-b9dd-166004a3ef4c" containerID="15c6ea44b4423a2b7db3a44c1613563d31b04a1322bf926495c74d3441a876c3" exitCode=0 Jun 11 16:54:31.859655 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.859584 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" event={"ID":"722101c5-4f4f-465d-b9dd-166004a3ef4c","Type":"ContainerDied","Data":"15c6ea44b4423a2b7db3a44c1613563d31b04a1322bf926495c74d3441a876c3"} Jun 11 16:54:31.861173 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.861148 2580 generic.go:356] "Generic (PLEG): container finished" podID="d64550a0-5c48-4803-9de3-36c77f8576ea" containerID="e11b800cd71b6cae1c9b54f9a0e3b964e9aefb3e7bdb91a9d12356538e8ff777" exitCode=0 Jun 11 16:54:31.861282 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.861228 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" event={"ID":"d64550a0-5c48-4803-9de3-36c77f8576ea","Type":"ContainerDied","Data":"e11b800cd71b6cae1c9b54f9a0e3b964e9aefb3e7bdb91a9d12356538e8ff777"} Jun 11 16:54:31.861282 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.861267 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" event={"ID":"d64550a0-5c48-4803-9de3-36c77f8576ea","Type":"ContainerStarted","Data":"5208e7500026293e37c415147ee26941e137a6dc4fb551f1dba041a418042aca"} Jun 11 16:54:31.863174 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.863150 2580 generic.go:356] "Generic (PLEG): container finished" podID="5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" containerID="576cb8b7428b3d4ec57448c6c1078242b61cf8c6853c094c5a88552e42d620ac" exitCode=0 Jun 11 16:54:31.863265 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.863233 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" event={"ID":"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5","Type":"ContainerDied","Data":"576cb8b7428b3d4ec57448c6c1078242b61cf8c6853c094c5a88552e42d620ac"} Jun 11 16:54:31.865090 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.865069 2580 generic.go:356] "Generic (PLEG): container finished" podID="4be8a280-e763-406e-9fdf-15aed9cacbd7" containerID="226b092d30df1fa012bdab09c3d56d732356d4f70fe835d40fa662cc87cf1578" exitCode=0 Jun 11 16:54:31.865183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.865105 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" event={"ID":"4be8a280-e763-406e-9fdf-15aed9cacbd7","Type":"ContainerDied","Data":"226b092d30df1fa012bdab09c3d56d732356d4f70fe835d40fa662cc87cf1578"} Jun 11 16:54:31.865183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:31.865132 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" event={"ID":"4be8a280-e763-406e-9fdf-15aed9cacbd7","Type":"ContainerStarted","Data":"22ddf9051fe7e9669bfe02469a5dc2b8137518a40baf462b28ac1e9ce4ffbdf3"} Jun 11 16:54:32.872494 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:32.872440 2580 generic.go:356] "Generic (PLEG): container finished" podID="d64550a0-5c48-4803-9de3-36c77f8576ea" containerID="48ecae3a1cd883b945fad168d03d16f03b827ef0e5d3850ff8f793968e48299c" exitCode=0 Jun 11 16:54:32.872915 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:32.872488 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" event={"ID":"d64550a0-5c48-4803-9de3-36c77f8576ea","Type":"ContainerDied","Data":"48ecae3a1cd883b945fad168d03d16f03b827ef0e5d3850ff8f793968e48299c"} Jun 11 16:54:32.876012 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:32.875980 2580 generic.go:356] "Generic (PLEG): container finished" podID="5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" containerID="d4e533fc1c05e6257cc8090937ba98f53490dd66c4e2aa5ba5e08ab5a80b8575" exitCode=0 Jun 11 16:54:32.876109 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:32.876028 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" event={"ID":"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5","Type":"ContainerDied","Data":"d4e533fc1c05e6257cc8090937ba98f53490dd66c4e2aa5ba5e08ab5a80b8575"} Jun 11 16:54:32.878163 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:32.878141 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" event={"ID":"722101c5-4f4f-465d-b9dd-166004a3ef4c","Type":"ContainerStarted","Data":"71599966c107469d1c68bfde5a0410d54a15165a8196f2c4ae9efe2257ef907c"} Jun 11 16:54:33.884804 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:33.884777 2580 generic.go:356] "Generic (PLEG): container finished" podID="d64550a0-5c48-4803-9de3-36c77f8576ea" containerID="d7475f4dcceff388c7fa9c571e6f6154ca0f2dfd2fb3c134f18fd1c0fac0df0f" exitCode=0 Jun 11 16:54:33.885195 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:33.884868 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" event={"ID":"d64550a0-5c48-4803-9de3-36c77f8576ea","Type":"ContainerDied","Data":"d7475f4dcceff388c7fa9c571e6f6154ca0f2dfd2fb3c134f18fd1c0fac0df0f"} Jun 11 16:54:33.886608 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:33.886586 2580 generic.go:356] "Generic (PLEG): container finished" podID="4be8a280-e763-406e-9fdf-15aed9cacbd7" containerID="f5e43063e7d91a7600488bf05a71877923e4756fbdf3eb030ee10b2a1b7ab859" exitCode=0 Jun 11 16:54:33.886736 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:33.886667 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" event={"ID":"4be8a280-e763-406e-9fdf-15aed9cacbd7","Type":"ContainerDied","Data":"f5e43063e7d91a7600488bf05a71877923e4756fbdf3eb030ee10b2a1b7ab859"} Jun 11 16:54:33.894332 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:33.889326 2580 generic.go:356] "Generic (PLEG): container finished" podID="722101c5-4f4f-465d-b9dd-166004a3ef4c" containerID="71599966c107469d1c68bfde5a0410d54a15165a8196f2c4ae9efe2257ef907c" exitCode=0 Jun 11 16:54:33.894332 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:33.889630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" event={"ID":"722101c5-4f4f-465d-b9dd-166004a3ef4c","Type":"ContainerDied","Data":"71599966c107469d1c68bfde5a0410d54a15165a8196f2c4ae9efe2257ef907c"} Jun 11 16:54:34.039561 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.039532 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:34.183163 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.183090 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqn2p\" (UniqueName: \"kubernetes.io/projected/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-kube-api-access-gqn2p\") pod \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " Jun 11 16:54:34.183163 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.183133 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-util\") pod \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " Jun 11 16:54:34.183359 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.183194 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-bundle\") pod \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\" (UID: \"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5\") " Jun 11 16:54:34.183724 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.183694 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-bundle" (OuterVolumeSpecName: "bundle") pod "5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" (UID: "5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:54:34.185353 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.185332 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-kube-api-access-gqn2p" (OuterVolumeSpecName: "kube-api-access-gqn2p") pod "5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" (UID: "5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5"). InnerVolumeSpecName "kube-api-access-gqn2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:54:34.188399 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.188373 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-util" (OuterVolumeSpecName: "util") pod "5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" (UID: "5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:54:34.284004 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.283952 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqn2p\" (UniqueName: \"kubernetes.io/projected/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-kube-api-access-gqn2p\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:34.284004 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.283997 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-util\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:34.284004 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.284006 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5-bundle\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:34.896184 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.896149 2580 generic.go:356] "Generic (PLEG): container finished" podID="722101c5-4f4f-465d-b9dd-166004a3ef4c" containerID="d0e4f716edd7d4d982d699eeb29c84b70007fa6cade2559577a515dfcff963dd" exitCode=0 Jun 11 16:54:34.896669 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.896236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" event={"ID":"722101c5-4f4f-465d-b9dd-166004a3ef4c","Type":"ContainerDied","Data":"d0e4f716edd7d4d982d699eeb29c84b70007fa6cade2559577a515dfcff963dd"} Jun 11 16:54:34.898127 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.898105 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" Jun 11 16:54:34.898259 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.898105 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh" event={"ID":"5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5","Type":"ContainerDied","Data":"540238a593f02d6b2ddb48a6a8082b1a25119afb9c503ea6d9fa405726e2056c"} Jun 11 16:54:34.898259 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.898213 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="540238a593f02d6b2ddb48a6a8082b1a25119afb9c503ea6d9fa405726e2056c" Jun 11 16:54:34.900355 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.900331 2580 generic.go:356] "Generic (PLEG): container finished" podID="4be8a280-e763-406e-9fdf-15aed9cacbd7" containerID="30aee577b86492233063f27d2170ed310633b4944e13877fc4e4317f0fffb570" exitCode=0 Jun 11 16:54:34.900495 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:34.900414 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" event={"ID":"4be8a280-e763-406e-9fdf-15aed9cacbd7","Type":"ContainerDied","Data":"30aee577b86492233063f27d2170ed310633b4944e13877fc4e4317f0fffb570"} Jun 11 16:54:35.037323 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.037300 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:35.191399 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.191319 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8smv\" (UniqueName: \"kubernetes.io/projected/d64550a0-5c48-4803-9de3-36c77f8576ea-kube-api-access-k8smv\") pod \"d64550a0-5c48-4803-9de3-36c77f8576ea\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " Jun 11 16:54:35.191399 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.191365 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-bundle\") pod \"d64550a0-5c48-4803-9de3-36c77f8576ea\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " Jun 11 16:54:35.191604 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.191404 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-util\") pod \"d64550a0-5c48-4803-9de3-36c77f8576ea\" (UID: \"d64550a0-5c48-4803-9de3-36c77f8576ea\") " Jun 11 16:54:35.191861 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.191832 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-bundle" (OuterVolumeSpecName: "bundle") pod "d64550a0-5c48-4803-9de3-36c77f8576ea" (UID: "d64550a0-5c48-4803-9de3-36c77f8576ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:54:35.193645 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.193623 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d64550a0-5c48-4803-9de3-36c77f8576ea-kube-api-access-k8smv" (OuterVolumeSpecName: "kube-api-access-k8smv") pod "d64550a0-5c48-4803-9de3-36c77f8576ea" (UID: "d64550a0-5c48-4803-9de3-36c77f8576ea"). InnerVolumeSpecName "kube-api-access-k8smv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:54:35.196173 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.196151 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-util" (OuterVolumeSpecName: "util") pod "d64550a0-5c48-4803-9de3-36c77f8576ea" (UID: "d64550a0-5c48-4803-9de3-36c77f8576ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:54:35.292711 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.292675 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-bundle\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:35.292711 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.292701 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d64550a0-5c48-4803-9de3-36c77f8576ea-util\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:35.292711 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.292711 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8smv\" (UniqueName: \"kubernetes.io/projected/d64550a0-5c48-4803-9de3-36c77f8576ea-kube-api-access-k8smv\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:35.907488 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.907428 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" event={"ID":"d64550a0-5c48-4803-9de3-36c77f8576ea","Type":"ContainerDied","Data":"5208e7500026293e37c415147ee26941e137a6dc4fb551f1dba041a418042aca"} Jun 11 16:54:35.907895 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.907517 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5208e7500026293e37c415147ee26941e137a6dc4fb551f1dba041a418042aca" Jun 11 16:54:35.907895 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:35.907438 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4" Jun 11 16:54:36.060076 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.060053 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:36.062530 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.062511 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:36.201248 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.201154 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-util\") pod \"722101c5-4f4f-465d-b9dd-166004a3ef4c\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " Jun 11 16:54:36.201248 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.201201 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-bundle\") pod \"722101c5-4f4f-465d-b9dd-166004a3ef4c\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " Jun 11 16:54:36.201248 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.201231 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nrkw\" (UniqueName: \"kubernetes.io/projected/722101c5-4f4f-465d-b9dd-166004a3ef4c-kube-api-access-2nrkw\") pod \"722101c5-4f4f-465d-b9dd-166004a3ef4c\" (UID: \"722101c5-4f4f-465d-b9dd-166004a3ef4c\") " Jun 11 16:54:36.201542 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.201262 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-bundle\") pod \"4be8a280-e763-406e-9fdf-15aed9cacbd7\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " Jun 11 16:54:36.201542 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.201295 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-util\") pod \"4be8a280-e763-406e-9fdf-15aed9cacbd7\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " Jun 11 16:54:36.201542 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.201338 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72vtm\" (UniqueName: \"kubernetes.io/projected/4be8a280-e763-406e-9fdf-15aed9cacbd7-kube-api-access-72vtm\") pod \"4be8a280-e763-406e-9fdf-15aed9cacbd7\" (UID: \"4be8a280-e763-406e-9fdf-15aed9cacbd7\") " Jun 11 16:54:36.201959 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.201930 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-bundle" (OuterVolumeSpecName: "bundle") pod "722101c5-4f4f-465d-b9dd-166004a3ef4c" (UID: "722101c5-4f4f-465d-b9dd-166004a3ef4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:54:36.201959 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.201936 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-bundle" (OuterVolumeSpecName: "bundle") pod "4be8a280-e763-406e-9fdf-15aed9cacbd7" (UID: "4be8a280-e763-406e-9fdf-15aed9cacbd7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:54:36.203698 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.203679 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/722101c5-4f4f-465d-b9dd-166004a3ef4c-kube-api-access-2nrkw" (OuterVolumeSpecName: "kube-api-access-2nrkw") pod "722101c5-4f4f-465d-b9dd-166004a3ef4c" (UID: "722101c5-4f4f-465d-b9dd-166004a3ef4c"). InnerVolumeSpecName "kube-api-access-2nrkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:54:36.203698 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.203684 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4be8a280-e763-406e-9fdf-15aed9cacbd7-kube-api-access-72vtm" (OuterVolumeSpecName: "kube-api-access-72vtm") pod "4be8a280-e763-406e-9fdf-15aed9cacbd7" (UID: "4be8a280-e763-406e-9fdf-15aed9cacbd7"). InnerVolumeSpecName "kube-api-access-72vtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:54:36.210116 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.210090 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-util" (OuterVolumeSpecName: "util") pod "722101c5-4f4f-465d-b9dd-166004a3ef4c" (UID: "722101c5-4f4f-465d-b9dd-166004a3ef4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:54:36.210378 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.210362 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-util" (OuterVolumeSpecName: "util") pod "4be8a280-e763-406e-9fdf-15aed9cacbd7" (UID: "4be8a280-e763-406e-9fdf-15aed9cacbd7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:54:36.302780 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.302751 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72vtm\" (UniqueName: \"kubernetes.io/projected/4be8a280-e763-406e-9fdf-15aed9cacbd7-kube-api-access-72vtm\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:36.302780 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.302779 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-util\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:36.302780 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.302788 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/722101c5-4f4f-465d-b9dd-166004a3ef4c-bundle\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:36.302985 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.302797 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nrkw\" (UniqueName: \"kubernetes.io/projected/722101c5-4f4f-465d-b9dd-166004a3ef4c-kube-api-access-2nrkw\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:36.302985 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.302806 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-bundle\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:36.302985 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.302813 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be8a280-e763-406e-9fdf-15aed9cacbd7-util\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:54:36.919645 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.919618 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" Jun 11 16:54:36.920063 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.919647 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq" event={"ID":"4be8a280-e763-406e-9fdf-15aed9cacbd7","Type":"ContainerDied","Data":"22ddf9051fe7e9669bfe02469a5dc2b8137518a40baf462b28ac1e9ce4ffbdf3"} Jun 11 16:54:36.920063 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.919713 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22ddf9051fe7e9669bfe02469a5dc2b8137518a40baf462b28ac1e9ce4ffbdf3" Jun 11 16:54:36.921626 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.921604 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" Jun 11 16:54:36.921743 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.921603 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj" event={"ID":"722101c5-4f4f-465d-b9dd-166004a3ef4c","Type":"ContainerDied","Data":"42d56b27f13483c09e5ff66d5b1a61f6e231e0512a2132c075ce9c191d13700a"} Jun 11 16:54:36.921743 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:36.921719 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42d56b27f13483c09e5ff66d5b1a61f6e231e0512a2132c075ce9c191d13700a" Jun 11 16:54:38.474972 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:38.474935 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:38.475489 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:38.475000 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:38.479845 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:38.479824 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:38.935742 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:38.935708 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-576d584b54-2s282" Jun 11 16:54:46.652838 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.652800 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p"] Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653102 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be8a280-e763-406e-9fdf-15aed9cacbd7" containerName="util" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653112 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be8a280-e763-406e-9fdf-15aed9cacbd7" containerName="util" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653123 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be8a280-e763-406e-9fdf-15aed9cacbd7" containerName="extract" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653129 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be8a280-e763-406e-9fdf-15aed9cacbd7" containerName="extract" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653137 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="722101c5-4f4f-465d-b9dd-166004a3ef4c" containerName="extract" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653142 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="722101c5-4f4f-465d-b9dd-166004a3ef4c" containerName="extract" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653150 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d64550a0-5c48-4803-9de3-36c77f8576ea" containerName="util" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653155 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d64550a0-5c48-4803-9de3-36c77f8576ea" containerName="util" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653162 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" containerName="util" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653167 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" containerName="util" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653172 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d64550a0-5c48-4803-9de3-36c77f8576ea" containerName="extract" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653178 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d64550a0-5c48-4803-9de3-36c77f8576ea" containerName="extract" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653185 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be8a280-e763-406e-9fdf-15aed9cacbd7" containerName="pull" Jun 11 16:54:46.653183 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653190 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be8a280-e763-406e-9fdf-15aed9cacbd7" containerName="pull" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653197 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" containerName="pull" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653202 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" containerName="pull" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653209 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d64550a0-5c48-4803-9de3-36c77f8576ea" containerName="pull" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653213 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d64550a0-5c48-4803-9de3-36c77f8576ea" containerName="pull" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653221 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="722101c5-4f4f-465d-b9dd-166004a3ef4c" containerName="util" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653226 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="722101c5-4f4f-465d-b9dd-166004a3ef4c" containerName="util" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653237 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" containerName="extract" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653241 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" containerName="extract" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653247 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="722101c5-4f4f-465d-b9dd-166004a3ef4c" containerName="pull" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653251 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="722101c5-4f4f-465d-b9dd-166004a3ef4c" containerName="pull" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653303 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5" containerName="extract" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653311 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d64550a0-5c48-4803-9de3-36c77f8576ea" containerName="extract" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653317 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4be8a280-e763-406e-9fdf-15aed9cacbd7" containerName="extract" Jun 11 16:54:46.653610 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.653325 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="722101c5-4f4f-465d-b9dd-166004a3ef4c" containerName="extract" Jun 11 16:54:46.661605 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.661581 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p" Jun 11 16:54:46.665000 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.664966 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dx6t2\"" Jun 11 16:54:46.676128 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.676105 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p"] Jun 11 16:54:46.691495 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.691466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6n64\" (UniqueName: \"kubernetes.io/projected/320c5f0b-8864-4385-becc-579dade89a90-kube-api-access-k6n64\") pod \"authorino-operator-75cc8d5cb7-vsk8p\" (UID: \"320c5f0b-8864-4385-becc-579dade89a90\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p" Jun 11 16:54:46.792777 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.792740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6n64\" (UniqueName: \"kubernetes.io/projected/320c5f0b-8864-4385-becc-579dade89a90-kube-api-access-k6n64\") pod \"authorino-operator-75cc8d5cb7-vsk8p\" (UID: \"320c5f0b-8864-4385-becc-579dade89a90\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p" Jun 11 16:54:46.805934 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.805907 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6n64\" (UniqueName: \"kubernetes.io/projected/320c5f0b-8864-4385-becc-579dade89a90-kube-api-access-k6n64\") pod \"authorino-operator-75cc8d5cb7-vsk8p\" (UID: \"320c5f0b-8864-4385-becc-579dade89a90\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p" Jun 11 16:54:46.971979 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:46.971894 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p" Jun 11 16:54:47.263104 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:47.263079 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p"] Jun 11 16:54:47.265867 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:54:47.265837 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320c5f0b_8864_4385_becc_579dade89a90.slice/crio-be1aff3aefbb44c0f4e335290adcc64ab0c9189252b8192d290ef79f281dbf06 WatchSource:0}: Error finding container be1aff3aefbb44c0f4e335290adcc64ab0c9189252b8192d290ef79f281dbf06: Status 404 returned error can't find the container with id be1aff3aefbb44c0f4e335290adcc64ab0c9189252b8192d290ef79f281dbf06 Jun 11 16:54:47.979055 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:47.979013 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p" event={"ID":"320c5f0b-8864-4385-becc-579dade89a90","Type":"ContainerStarted","Data":"be1aff3aefbb44c0f4e335290adcc64ab0c9189252b8192d290ef79f281dbf06"} Jun 11 16:54:49.581460 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:49.581423 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km"] Jun 11 16:54:49.584916 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:49.584897 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:54:49.587674 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:49.587645 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kw78c\"" Jun 11 16:54:49.608802 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:49.608768 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km"] Jun 11 16:54:49.617078 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:49.617052 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj2n8\" (UniqueName: \"kubernetes.io/projected/0f0f793e-4518-4cd5-8f11-8ac63e71568f-kube-api-access-rj2n8\") pod \"limitador-operator-controller-manager-859d7b78bd-tg6km\" (UID: \"0f0f793e-4518-4cd5-8f11-8ac63e71568f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:54:49.717779 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:49.717738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj2n8\" (UniqueName: \"kubernetes.io/projected/0f0f793e-4518-4cd5-8f11-8ac63e71568f-kube-api-access-rj2n8\") pod \"limitador-operator-controller-manager-859d7b78bd-tg6km\" (UID: \"0f0f793e-4518-4cd5-8f11-8ac63e71568f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:54:49.732923 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:49.732891 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj2n8\" (UniqueName: \"kubernetes.io/projected/0f0f793e-4518-4cd5-8f11-8ac63e71568f-kube-api-access-rj2n8\") pod \"limitador-operator-controller-manager-859d7b78bd-tg6km\" (UID: \"0f0f793e-4518-4cd5-8f11-8ac63e71568f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:54:49.895893 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:49.895873 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:54:49.993726 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:49.993697 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p" event={"ID":"320c5f0b-8864-4385-becc-579dade89a90","Type":"ContainerStarted","Data":"21c8a52c861fff8b4d15ddfbb4bee0e23af17917e4b4c74227403774562fd88e"} Jun 11 16:54:49.993887 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:49.993852 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p" Jun 11 16:54:50.034807 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:50.034720 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p" podStartSLOduration=1.413027639 podStartE2EDuration="4.034701411s" totalImagesPullingTime="2.621673772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:50.03381062 +0000 UTC m=+643.012286150" watchObservedRunningTime="2026-06-11 16:54:50.034701411 +0000 UTC m=+643.013176940" Jun 11 16:54:50.061691 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:50.061664 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km"] Jun 11 16:54:50.065844 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:54:50.065808 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0f793e_4518_4cd5_8f11_8ac63e71568f.slice/crio-4d16cd08588606320d74eb5da81ca0f0853097d82d4448a88b50b27265a78763 WatchSource:0}: Error finding container 4d16cd08588606320d74eb5da81ca0f0853097d82d4448a88b50b27265a78763: Status 404 returned error can't find the container with id 4d16cd08588606320d74eb5da81ca0f0853097d82d4448a88b50b27265a78763 Jun 11 16:54:51.000191 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:51.000155 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" event={"ID":"0f0f793e-4518-4cd5-8f11-8ac63e71568f","Type":"ContainerStarted","Data":"4d16cd08588606320d74eb5da81ca0f0853097d82d4448a88b50b27265a78763"} Jun 11 16:54:52.006793 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:52.006756 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" event={"ID":"0f0f793e-4518-4cd5-8f11-8ac63e71568f","Type":"ContainerStarted","Data":"3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431"} Jun 11 16:54:52.007189 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:54:52.006837 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:55:01.002896 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:01.002864 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsk8p" Jun 11 16:55:01.031802 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:01.031757 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" podStartSLOduration=10.617943209 podStartE2EDuration="12.031744493s" totalImagesPullingTime="1.413801284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:52.065390821 +0000 UTC m=+645.043866351" watchObservedRunningTime="2026-06-11 16:55:01.031744493 +0000 UTC m=+654.010220021" Jun 11 16:55:03.014422 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:03.014385 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:55:12.141682 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:12.141647 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km"] Jun 11 16:55:12.142138 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:12.141862 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" podUID="0f0f793e-4518-4cd5-8f11-8ac63e71568f" containerName="manager" containerID="cri-o://3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431" gracePeriod=2 Jun 11 16:55:12.166932 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:12.166903 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km"] Jun 11 16:55:12.183645 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:55:12.183609 2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0f0f793e-4518-4cd5-8f11-8ac63e71568f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-tg6km\": pods \"limitador-operator-controller-manager-859d7b78bd-tg6km\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:55:12.383036 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:12.383014 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:55:12.387283 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:55:12.387256 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tg6km\" is forbidden: User \"system:node:ip-10-0-129-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-76.ec2.internal' and this object" podUID="0f0f793e-4518-4cd5-8f11-8ac63e71568f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:55:12.498649 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:12.498572 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj2n8\" (UniqueName: \"kubernetes.io/projected/0f0f793e-4518-4cd5-8f11-8ac63e71568f-kube-api-access-rj2n8\") pod \"0f0f793e-4518-4cd5-8f11-8ac63e71568f\" (UID: \"0f0f793e-4518-4cd5-8f11-8ac63e71568f\") " Jun 11 16:55:12.500723 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:12.500694 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f0f793e-4518-4cd5-8f11-8ac63e71568f-kube-api-access-rj2n8" (OuterVolumeSpecName: "kube-api-access-rj2n8") pod "0f0f793e-4518-4cd5-8f11-8ac63e71568f" (UID: "0f0f793e-4518-4cd5-8f11-8ac63e71568f"). InnerVolumeSpecName "kube-api-access-rj2n8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:55:12.599154 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:12.599122 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj2n8\" (UniqueName: \"kubernetes.io/projected/0f0f793e-4518-4cd5-8f11-8ac63e71568f-kube-api-access-rj2n8\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:55:13.119749 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:13.119686 2580 generic.go:356] "Generic (PLEG): container finished" podID="0f0f793e-4518-4cd5-8f11-8ac63e71568f" containerID="3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431" exitCode=0 Jun 11 16:55:13.119749 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:13.119735 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:55:13.119974 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:13.119791 2580 scope.go:117] "RemoveContainer" containerID="3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431" Jun 11 16:55:13.121920 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:55:13.121894 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tg6km\" is forbidden: User \"system:node:ip-10-0-129-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-76.ec2.internal' and this object" podUID="0f0f793e-4518-4cd5-8f11-8ac63e71568f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:55:13.129178 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:13.129161 2580 scope.go:117] "RemoveContainer" containerID="3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431" Jun 11 16:55:13.129474 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:55:13.129436 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431\": container with ID starting with 3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431 not found: ID does not exist" containerID="3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431" Jun 11 16:55:13.129545 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:13.129490 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431"} err="failed to get container status \"3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431\": rpc error: code = NotFound desc = could not find container \"3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431\": container with ID starting with 3f561aa60c27fe360d8d51d144ce8bbee7600ca9af4e6da55754d59fe2ed8431 not found: ID does not exist" Jun 11 16:55:13.131308 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:55:13.131287 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tg6km\" is forbidden: User \"system:node:ip-10-0-129-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-76.ec2.internal' and this object" podUID="0f0f793e-4518-4cd5-8f11-8ac63e71568f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tg6km" Jun 11 16:55:13.521907 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:13.521823 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f0f793e-4518-4cd5-8f11-8ac63e71568f" path="/var/lib/kubelet/pods/0f0f793e-4518-4cd5-8f11-8ac63e71568f/volumes" Jun 11 16:55:52.683526 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.683438 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886"] Jun 11 16:55:52.683950 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.683792 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f0f793e-4518-4cd5-8f11-8ac63e71568f" containerName="manager" Jun 11 16:55:52.683950 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.683802 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f0f793e-4518-4cd5-8f11-8ac63e71568f" containerName="manager" Jun 11 16:55:52.683950 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.683860 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f0f793e-4518-4cd5-8f11-8ac63e71568f" containerName="manager" Jun 11 16:55:52.686817 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.686800 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.689202 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.689185 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-527bx\"" Jun 11 16:55:52.699780 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.699756 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886"] Jun 11 16:55:52.747816 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.747788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/158ef541-0a86-4052-968b-4df7854a2445-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.747952 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.747833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.747952 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.747862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.747952 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.747907 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v56kw\" (UniqueName: \"kubernetes.io/projected/158ef541-0a86-4052-968b-4df7854a2445-kube-api-access-v56kw\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.748109 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.747971 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.748109 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.748015 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.748109 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.748053 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/158ef541-0a86-4052-968b-4df7854a2445-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.748109 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.748080 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.748237 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.748130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/158ef541-0a86-4052-968b-4df7854a2445-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.848971 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.848941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/158ef541-0a86-4052-968b-4df7854a2445-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849151 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.848978 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849151 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849008 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849151 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849052 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v56kw\" (UniqueName: \"kubernetes.io/projected/158ef541-0a86-4052-968b-4df7854a2445-kube-api-access-v56kw\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849151 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849367 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849228 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849367 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/158ef541-0a86-4052-968b-4df7854a2445-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849367 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849367 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849349 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/158ef541-0a86-4052-968b-4df7854a2445-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849571 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849416 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849571 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849507 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849706 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849631 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849761 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849723 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.849900 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.849881 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/158ef541-0a86-4052-968b-4df7854a2445-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.851783 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.851763 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/158ef541-0a86-4052-968b-4df7854a2445-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.851960 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.851939 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/158ef541-0a86-4052-968b-4df7854a2445-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.861937 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.861912 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v56kw\" (UniqueName: \"kubernetes.io/projected/158ef541-0a86-4052-968b-4df7854a2445-kube-api-access-v56kw\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.862941 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.862921 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/158ef541-0a86-4052-968b-4df7854a2445-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-cj886\" (UID: \"158ef541-0a86-4052-968b-4df7854a2445\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:52.996783 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:52.996688 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:53.136488 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:53.136460 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886"] Jun 11 16:55:53.138552 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:55:53.138509 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158ef541_0a86_4052_968b_4df7854a2445.slice/crio-743f2d9fa724e830d2051061745bf6a2094d5f04e5b50ae352d9f6e9b70da53f WatchSource:0}: Error finding container 743f2d9fa724e830d2051061745bf6a2094d5f04e5b50ae352d9f6e9b70da53f: Status 404 returned error can't find the container with id 743f2d9fa724e830d2051061745bf6a2094d5f04e5b50ae352d9f6e9b70da53f Jun 11 16:55:53.142945 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:53.142913 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:55:53.143051 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:53.142990 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:55:53.143113 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:53.143066 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:55:53.325346 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:53.325256 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" event={"ID":"158ef541-0a86-4052-968b-4df7854a2445","Type":"ContainerStarted","Data":"2107b4aef30c2dd7194913f1c7cd6c6f752d2cb31089b45e5eefb1542d980618"} Jun 11 16:55:53.325346 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:53.325328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" event={"ID":"158ef541-0a86-4052-968b-4df7854a2445","Type":"ContainerStarted","Data":"743f2d9fa724e830d2051061745bf6a2094d5f04e5b50ae352d9f6e9b70da53f"} Jun 11 16:55:53.355512 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:53.355422 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" podStartSLOduration=1.355406157 podStartE2EDuration="1.355406157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:55:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:53.351753217 +0000 UTC m=+706.330228747" watchObservedRunningTime="2026-06-11 16:55:53.355406157 +0000 UTC m=+706.333881687" Jun 11 16:55:53.997751 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:53.997712 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:54.392878 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.392840 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzt2j"] Jun 11 16:55:54.396232 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.396210 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:55:54.399669 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.399647 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qfjql\"" Jun 11 16:55:54.400260 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.400234 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 16:55:54.406005 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.405983 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzt2j"] Jun 11 16:55:54.464195 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.464143 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm6tg\" (UniqueName: \"kubernetes.io/projected/1675c03c-fc8b-4ecb-870c-f588dccbd669-kube-api-access-nm6tg\") pod \"limitador-limitador-64c94fd64f-gzt2j\" (UID: \"1675c03c-fc8b-4ecb-870c-f588dccbd669\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:55:54.464375 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.464198 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1675c03c-fc8b-4ecb-870c-f588dccbd669-config-file\") pod \"limitador-limitador-64c94fd64f-gzt2j\" (UID: \"1675c03c-fc8b-4ecb-870c-f588dccbd669\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:55:54.478318 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.478275 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzt2j"] Jun 11 16:55:54.565234 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.565197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm6tg\" (UniqueName: \"kubernetes.io/projected/1675c03c-fc8b-4ecb-870c-f588dccbd669-kube-api-access-nm6tg\") pod \"limitador-limitador-64c94fd64f-gzt2j\" (UID: \"1675c03c-fc8b-4ecb-870c-f588dccbd669\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:55:54.565234 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.565236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1675c03c-fc8b-4ecb-870c-f588dccbd669-config-file\") pod \"limitador-limitador-64c94fd64f-gzt2j\" (UID: \"1675c03c-fc8b-4ecb-870c-f588dccbd669\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:55:54.566140 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.566116 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1675c03c-fc8b-4ecb-870c-f588dccbd669-config-file\") pod \"limitador-limitador-64c94fd64f-gzt2j\" (UID: \"1675c03c-fc8b-4ecb-870c-f588dccbd669\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:55:54.574282 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.574247 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm6tg\" (UniqueName: \"kubernetes.io/projected/1675c03c-fc8b-4ecb-870c-f588dccbd669-kube-api-access-nm6tg\") pod \"limitador-limitador-64c94fd64f-gzt2j\" (UID: \"1675c03c-fc8b-4ecb-870c-f588dccbd669\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:55:54.707242 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.707154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:55:54.846246 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:54.846218 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzt2j"] Jun 11 16:55:54.847960 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:55:54.847936 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1675c03c_fc8b_4ecb_870c_f588dccbd669.slice/crio-957133fc35bbf0c969490e2a868ccbc5d11df4bfd1367b8f789ab0ff5328772b WatchSource:0}: Error finding container 957133fc35bbf0c969490e2a868ccbc5d11df4bfd1367b8f789ab0ff5328772b: Status 404 returned error can't find the container with id 957133fc35bbf0c969490e2a868ccbc5d11df4bfd1367b8f789ab0ff5328772b Jun 11 16:55:55.024513 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:55.024426 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:55.338054 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:55.337971 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" event={"ID":"1675c03c-fc8b-4ecb-870c-f588dccbd669","Type":"ContainerStarted","Data":"957133fc35bbf0c969490e2a868ccbc5d11df4bfd1367b8f789ab0ff5328772b"} Jun 11 16:55:55.338323 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:55.338301 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:55.339398 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:55.339378 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:55:58.357851 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:58.357821 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" event={"ID":"1675c03c-fc8b-4ecb-870c-f588dccbd669","Type":"ContainerStarted","Data":"e97bafd19d14483bc25d798a2b141f4fec712b7ebccceb192a44b9cae917c0f9"} Jun 11 16:55:58.358240 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:58.357872 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:55:58.384682 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:55:58.384628 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" podStartSLOduration=1.806659687 podStartE2EDuration="4.38461085s" totalImagesPullingTime="2.577951163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:58.383008037 +0000 UTC m=+711.361483567" watchObservedRunningTime="2026-06-11 16:55:58.38461085 +0000 UTC m=+711.363086378" Jun 11 16:56:08.925411 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:08.925375 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzt2j"] Jun 11 16:56:08.925891 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:08.925644 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" podUID="1675c03c-fc8b-4ecb-870c-f588dccbd669" containerName="limitador" containerID="cri-o://e97bafd19d14483bc25d798a2b141f4fec712b7ebccceb192a44b9cae917c0f9" gracePeriod=30 Jun 11 16:56:08.926377 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:08.926328 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:56:09.262571 ip-10-0-129-76 kubenswrapper[2580]: E0611 16:56:09.262537 2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1675c03c_fc8b_4ecb_870c_f588dccbd669.slice/crio-e97bafd19d14483bc25d798a2b141f4fec712b7ebccceb192a44b9cae917c0f9.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1675c03c_fc8b_4ecb_870c_f588dccbd669.slice/crio-conmon-e97bafd19d14483bc25d798a2b141f4fec712b7ebccceb192a44b9cae917c0f9.scope\": RecentStats: unable to find data in memory cache]" Jun 11 16:56:09.421665 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:09.421637 2580 generic.go:356] "Generic (PLEG): container finished" podID="1675c03c-fc8b-4ecb-870c-f588dccbd669" containerID="e97bafd19d14483bc25d798a2b141f4fec712b7ebccceb192a44b9cae917c0f9" exitCode=0 Jun 11 16:56:09.421799 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:09.421710 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" event={"ID":"1675c03c-fc8b-4ecb-870c-f588dccbd669","Type":"ContainerDied","Data":"e97bafd19d14483bc25d798a2b141f4fec712b7ebccceb192a44b9cae917c0f9"} Jun 11 16:56:09.467752 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:09.467732 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:56:09.587997 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:09.587902 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm6tg\" (UniqueName: \"kubernetes.io/projected/1675c03c-fc8b-4ecb-870c-f588dccbd669-kube-api-access-nm6tg\") pod \"1675c03c-fc8b-4ecb-870c-f588dccbd669\" (UID: \"1675c03c-fc8b-4ecb-870c-f588dccbd669\") " Jun 11 16:56:09.587997 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:09.587949 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1675c03c-fc8b-4ecb-870c-f588dccbd669-config-file\") pod \"1675c03c-fc8b-4ecb-870c-f588dccbd669\" (UID: \"1675c03c-fc8b-4ecb-870c-f588dccbd669\") " Jun 11 16:56:09.588299 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:09.588277 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1675c03c-fc8b-4ecb-870c-f588dccbd669-config-file" (OuterVolumeSpecName: "config-file") pod "1675c03c-fc8b-4ecb-870c-f588dccbd669" (UID: "1675c03c-fc8b-4ecb-870c-f588dccbd669"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:56:09.590168 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:09.590144 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1675c03c-fc8b-4ecb-870c-f588dccbd669-kube-api-access-nm6tg" (OuterVolumeSpecName: "kube-api-access-nm6tg") pod "1675c03c-fc8b-4ecb-870c-f588dccbd669" (UID: "1675c03c-fc8b-4ecb-870c-f588dccbd669"). InnerVolumeSpecName "kube-api-access-nm6tg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:56:09.688770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:09.688736 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm6tg\" (UniqueName: \"kubernetes.io/projected/1675c03c-fc8b-4ecb-870c-f588dccbd669-kube-api-access-nm6tg\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:56:09.688770 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:09.688764 2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1675c03c-fc8b-4ecb-870c-f588dccbd669-config-file\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:56:10.428135 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.428106 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" Jun 11 16:56:10.428595 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.428130 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gzt2j" event={"ID":"1675c03c-fc8b-4ecb-870c-f588dccbd669","Type":"ContainerDied","Data":"957133fc35bbf0c969490e2a868ccbc5d11df4bfd1367b8f789ab0ff5328772b"} Jun 11 16:56:10.428595 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.428215 2580 scope.go:117] "RemoveContainer" containerID="e97bafd19d14483bc25d798a2b141f4fec712b7ebccceb192a44b9cae917c0f9" Jun 11 16:56:10.455483 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.455438 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzt2j"] Jun 11 16:56:10.460131 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.460105 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gzt2j"] Jun 11 16:56:10.466465 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.466417 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-w4vtq"] Jun 11 16:56:10.466949 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.466926 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1675c03c-fc8b-4ecb-870c-f588dccbd669" containerName="limitador" Jun 11 16:56:10.467019 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.466953 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1675c03c-fc8b-4ecb-870c-f588dccbd669" containerName="limitador" Jun 11 16:56:10.467081 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.467067 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1675c03c-fc8b-4ecb-870c-f588dccbd669" containerName="limitador" Jun 11 16:56:10.471588 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.471555 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-w4vtq" Jun 11 16:56:10.473790 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.473773 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 16:56:10.479125 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.479102 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-w4vtq"] Jun 11 16:56:10.598557 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.598524 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f720755d-11cc-4a4a-b124-5b11d42ff875-data\") pod \"postgres-69fb4594cf-w4vtq\" (UID: \"f720755d-11cc-4a4a-b124-5b11d42ff875\") " pod="opendatahub/postgres-69fb4594cf-w4vtq" Jun 11 16:56:10.598726 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.598599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txz4q\" (UniqueName: \"kubernetes.io/projected/f720755d-11cc-4a4a-b124-5b11d42ff875-kube-api-access-txz4q\") pod \"postgres-69fb4594cf-w4vtq\" (UID: \"f720755d-11cc-4a4a-b124-5b11d42ff875\") " pod="opendatahub/postgres-69fb4594cf-w4vtq" Jun 11 16:56:10.699983 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.699892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txz4q\" (UniqueName: \"kubernetes.io/projected/f720755d-11cc-4a4a-b124-5b11d42ff875-kube-api-access-txz4q\") pod \"postgres-69fb4594cf-w4vtq\" (UID: \"f720755d-11cc-4a4a-b124-5b11d42ff875\") " pod="opendatahub/postgres-69fb4594cf-w4vtq" Jun 11 16:56:10.699983 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.699943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f720755d-11cc-4a4a-b124-5b11d42ff875-data\") pod \"postgres-69fb4594cf-w4vtq\" (UID: \"f720755d-11cc-4a4a-b124-5b11d42ff875\") " pod="opendatahub/postgres-69fb4594cf-w4vtq" Jun 11 16:56:10.700327 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.700310 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f720755d-11cc-4a4a-b124-5b11d42ff875-data\") pod \"postgres-69fb4594cf-w4vtq\" (UID: \"f720755d-11cc-4a4a-b124-5b11d42ff875\") " pod="opendatahub/postgres-69fb4594cf-w4vtq" Jun 11 16:56:10.708643 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.708620 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txz4q\" (UniqueName: \"kubernetes.io/projected/f720755d-11cc-4a4a-b124-5b11d42ff875-kube-api-access-txz4q\") pod \"postgres-69fb4594cf-w4vtq\" (UID: \"f720755d-11cc-4a4a-b124-5b11d42ff875\") " pod="opendatahub/postgres-69fb4594cf-w4vtq" Jun 11 16:56:10.782518 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.782473 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-w4vtq" Jun 11 16:56:10.913663 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:10.913639 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-w4vtq"] Jun 11 16:56:10.915568 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:56:10.915531 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf720755d_11cc_4a4a_b124_5b11d42ff875.slice/crio-1e57f497196bd4bc763a882bc16c979542444ad02a993b299b90443148cdf9c9 WatchSource:0}: Error finding container 1e57f497196bd4bc763a882bc16c979542444ad02a993b299b90443148cdf9c9: Status 404 returned error can't find the container with id 1e57f497196bd4bc763a882bc16c979542444ad02a993b299b90443148cdf9c9 Jun 11 16:56:11.436439 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:11.436408 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-w4vtq" event={"ID":"f720755d-11cc-4a4a-b124-5b11d42ff875","Type":"ContainerStarted","Data":"1e57f497196bd4bc763a882bc16c979542444ad02a993b299b90443148cdf9c9"} Jun 11 16:56:11.522631 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:11.522594 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1675c03c-fc8b-4ecb-870c-f588dccbd669" path="/var/lib/kubelet/pods/1675c03c-fc8b-4ecb-870c-f588dccbd669/volumes" Jun 11 16:56:14.455078 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:14.455046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-w4vtq" event={"ID":"f720755d-11cc-4a4a-b124-5b11d42ff875","Type":"ContainerStarted","Data":"4b070ce7c22c639b0608a821482adfcd5749d6e9d6b6531a3351249192606c23"} Jun 11 16:56:14.455512 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:14.455181 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-w4vtq" Jun 11 16:56:14.470714 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:14.470664 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-w4vtq" podStartSLOduration=1.785498477 podStartE2EDuration="4.470648006s" totalImagesPullingTime="2.685149529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:56:14.469840316 +0000 UTC m=+727.448315845" watchObservedRunningTime="2026-06-11 16:56:14.470648006 +0000 UTC m=+727.449123535" Jun 11 16:56:20.489706 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:20.489677 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-w4vtq" Jun 11 16:56:22.111842 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.111799 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p"] Jun 11 16:56:22.115492 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.115477 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:22.118288 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.118264 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:56:22.118659 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.118310 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:56:22.118887 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.118873 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h7k7\"" Jun 11 16:56:22.126510 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.126490 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p"] Jun 11 16:56:22.201279 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.201248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh6sm\" (UniqueName: \"kubernetes.io/projected/36196414-fa1b-4487-b826-109691c04a0e-kube-api-access-nh6sm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:22.201279 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.201283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:22.201493 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.201310 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:22.302594 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.302556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh6sm\" (UniqueName: \"kubernetes.io/projected/36196414-fa1b-4487-b826-109691c04a0e-kube-api-access-nh6sm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:22.302594 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.302593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:22.302815 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.302622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:22.302964 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.302949 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:22.302997 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.302977 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:22.313250 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.313226 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh6sm\" (UniqueName: \"kubernetes.io/projected/36196414-fa1b-4487-b826-109691c04a0e-kube-api-access-nh6sm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:22.425056 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.424976 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:22.558252 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:22.558229 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p"] Jun 11 16:56:22.560977 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:56:22.560946 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36196414_fa1b_4487_b826_109691c04a0e.slice/crio-f762a8e8b17fd1d54c708ab939a06f74c64dbb327fb5765ed74e77d567815437 WatchSource:0}: Error finding container f762a8e8b17fd1d54c708ab939a06f74c64dbb327fb5765ed74e77d567815437: Status 404 returned error can't find the container with id f762a8e8b17fd1d54c708ab939a06f74c64dbb327fb5765ed74e77d567815437 Jun 11 16:56:23.503034 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:23.503002 2580 generic.go:356] "Generic (PLEG): container finished" podID="36196414-fa1b-4487-b826-109691c04a0e" containerID="5d5e3ad0384bc41625b63b9513ea6cf989915f58eb4eaf18dc93885165d17a6b" exitCode=0 Jun 11 16:56:23.503552 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:23.503059 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" event={"ID":"36196414-fa1b-4487-b826-109691c04a0e","Type":"ContainerDied","Data":"5d5e3ad0384bc41625b63b9513ea6cf989915f58eb4eaf18dc93885165d17a6b"} Jun 11 16:56:23.503552 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:23.503101 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" event={"ID":"36196414-fa1b-4487-b826-109691c04a0e","Type":"ContainerStarted","Data":"f762a8e8b17fd1d54c708ab939a06f74c64dbb327fb5765ed74e77d567815437"} Jun 11 16:56:24.509996 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:24.509959 2580 generic.go:356] "Generic (PLEG): container finished" podID="36196414-fa1b-4487-b826-109691c04a0e" containerID="63b3fece19a324d9b4f53bd742da24348c5786463e8ba92c0c92ead75a38864a" exitCode=0 Jun 11 16:56:24.510367 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:24.510049 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" event={"ID":"36196414-fa1b-4487-b826-109691c04a0e","Type":"ContainerDied","Data":"63b3fece19a324d9b4f53bd742da24348c5786463e8ba92c0c92ead75a38864a"} Jun 11 16:56:25.517171 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:25.517140 2580 generic.go:356] "Generic (PLEG): container finished" podID="36196414-fa1b-4487-b826-109691c04a0e" containerID="d8da85842d1054bae8abc04eea9204ccdaaf76819e9a5e52bd04c2dff123723e" exitCode=0 Jun 11 16:56:25.520940 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:25.520913 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" event={"ID":"36196414-fa1b-4487-b826-109691c04a0e","Type":"ContainerDied","Data":"d8da85842d1054bae8abc04eea9204ccdaaf76819e9a5e52bd04c2dff123723e"} Jun 11 16:56:26.647926 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:26.647906 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:26.742144 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:26.742112 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-util\") pod \"36196414-fa1b-4487-b826-109691c04a0e\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " Jun 11 16:56:26.742306 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:26.742171 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nh6sm\" (UniqueName: \"kubernetes.io/projected/36196414-fa1b-4487-b826-109691c04a0e-kube-api-access-nh6sm\") pod \"36196414-fa1b-4487-b826-109691c04a0e\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " Jun 11 16:56:26.742306 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:26.742223 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-bundle\") pod \"36196414-fa1b-4487-b826-109691c04a0e\" (UID: \"36196414-fa1b-4487-b826-109691c04a0e\") " Jun 11 16:56:26.742853 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:26.742824 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-bundle" (OuterVolumeSpecName: "bundle") pod "36196414-fa1b-4487-b826-109691c04a0e" (UID: "36196414-fa1b-4487-b826-109691c04a0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:56:26.744413 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:26.744388 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36196414-fa1b-4487-b826-109691c04a0e-kube-api-access-nh6sm" (OuterVolumeSpecName: "kube-api-access-nh6sm") pod "36196414-fa1b-4487-b826-109691c04a0e" (UID: "36196414-fa1b-4487-b826-109691c04a0e"). InnerVolumeSpecName "kube-api-access-nh6sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:56:26.747750 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:26.747732 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-util" (OuterVolumeSpecName: "util") pod "36196414-fa1b-4487-b826-109691c04a0e" (UID: "36196414-fa1b-4487-b826-109691c04a0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:56:26.842867 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:26.842789 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-util\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:56:26.842867 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:26.842813 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh6sm\" (UniqueName: \"kubernetes.io/projected/36196414-fa1b-4487-b826-109691c04a0e-kube-api-access-nh6sm\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:56:26.842867 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:26.842822 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36196414-fa1b-4487-b826-109691c04a0e-bundle\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 16:56:27.529465 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:27.529422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" event={"ID":"36196414-fa1b-4487-b826-109691c04a0e","Type":"ContainerDied","Data":"f762a8e8b17fd1d54c708ab939a06f74c64dbb327fb5765ed74e77d567815437"} Jun 11 16:56:27.529565 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:27.529491 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f762a8e8b17fd1d54c708ab939a06f74c64dbb327fb5765ed74e77d567815437" Jun 11 16:56:27.529617 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:27.529569 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vdd8p" Jun 11 16:56:30.120920 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.120886 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-x89w6"] Jun 11 16:56:30.121290 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.121213 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36196414-fa1b-4487-b826-109691c04a0e" containerName="extract" Jun 11 16:56:30.121290 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.121224 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="36196414-fa1b-4487-b826-109691c04a0e" containerName="extract" Jun 11 16:56:30.121290 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.121241 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36196414-fa1b-4487-b826-109691c04a0e" containerName="util" Jun 11 16:56:30.121290 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.121246 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="36196414-fa1b-4487-b826-109691c04a0e" containerName="util" Jun 11 16:56:30.121290 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.121254 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36196414-fa1b-4487-b826-109691c04a0e" containerName="pull" Jun 11 16:56:30.121290 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.121259 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="36196414-fa1b-4487-b826-109691c04a0e" containerName="pull" Jun 11 16:56:30.121516 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.121313 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="36196414-fa1b-4487-b826-109691c04a0e" containerName="extract" Jun 11 16:56:30.123819 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.123801 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-x89w6" Jun 11 16:56:30.127548 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.127522 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 16:56:30.127653 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.127583 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 16:56:30.128342 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.128328 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-hzbd2\"" Jun 11 16:56:30.134844 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.134823 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-x89w6"] Jun 11 16:56:30.274575 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.274544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9k9m\" (UniqueName: \"kubernetes.io/projected/a10dae46-4ef0-4de1-91c7-99cce3ade986-kube-api-access-h9k9m\") pod \"keycloak-operator-d67dbbb48-x89w6\" (UID: \"a10dae46-4ef0-4de1-91c7-99cce3ade986\") " pod="keycloak-system/keycloak-operator-d67dbbb48-x89w6" Jun 11 16:56:30.375504 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.375415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9k9m\" (UniqueName: \"kubernetes.io/projected/a10dae46-4ef0-4de1-91c7-99cce3ade986-kube-api-access-h9k9m\") pod \"keycloak-operator-d67dbbb48-x89w6\" (UID: \"a10dae46-4ef0-4de1-91c7-99cce3ade986\") " pod="keycloak-system/keycloak-operator-d67dbbb48-x89w6" Jun 11 16:56:30.383979 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.383951 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9k9m\" (UniqueName: \"kubernetes.io/projected/a10dae46-4ef0-4de1-91c7-99cce3ade986-kube-api-access-h9k9m\") pod \"keycloak-operator-d67dbbb48-x89w6\" (UID: \"a10dae46-4ef0-4de1-91c7-99cce3ade986\") " pod="keycloak-system/keycloak-operator-d67dbbb48-x89w6" Jun 11 16:56:30.434036 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.434010 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-x89w6" Jun 11 16:56:30.576155 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:30.576122 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-x89w6"] Jun 11 16:56:30.577997 ip-10-0-129-76 kubenswrapper[2580]: W0611 16:56:30.577959 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10dae46_4ef0_4de1_91c7_99cce3ade986.slice/crio-34fd4c382055951c7c2798efef30e41ee266c6eeac746a2b2803edbf50d38308 WatchSource:0}: Error finding container 34fd4c382055951c7c2798efef30e41ee266c6eeac746a2b2803edbf50d38308: Status 404 returned error can't find the container with id 34fd4c382055951c7c2798efef30e41ee266c6eeac746a2b2803edbf50d38308 Jun 11 16:56:31.554467 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:31.554412 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-x89w6" event={"ID":"a10dae46-4ef0-4de1-91c7-99cce3ade986","Type":"ContainerStarted","Data":"34fd4c382055951c7c2798efef30e41ee266c6eeac746a2b2803edbf50d38308"} Jun 11 16:56:36.592680 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:36.592640 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-x89w6" event={"ID":"a10dae46-4ef0-4de1-91c7-99cce3ade986","Type":"ContainerStarted","Data":"70bbd444b8d784a36ee86d1d9cab529c9bc23155353b69edd8840d5edb8c660c"} Jun 11 16:56:36.609915 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:56:36.609861 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-x89w6" podStartSLOduration=1.212977486 podStartE2EDuration="6.609846317s" totalImagesPullingTime="5.396868831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:56:36.608813749 +0000 UTC m=+749.587289280" watchObservedRunningTime="2026-06-11 16:56:36.609846317 +0000 UTC m=+749.588321845" Jun 11 16:58:04.059984 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:04.059949 2580 generic.go:356] "Generic (PLEG): container finished" podID="158ef541-0a86-4052-968b-4df7854a2445" containerID="2107b4aef30c2dd7194913f1c7cd6c6f752d2cb31089b45e5eefb1542d980618" exitCode=0 Jun 11 16:58:04.060403 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:04.059996 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" event={"ID":"158ef541-0a86-4052-968b-4df7854a2445","Type":"ContainerDied","Data":"2107b4aef30c2dd7194913f1c7cd6c6f752d2cb31089b45e5eefb1542d980618"} Jun 11 16:58:04.060471 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:04.060398 2580 scope.go:117] "RemoveContainer" containerID="2107b4aef30c2dd7194913f1c7cd6c6f752d2cb31089b45e5eefb1542d980618" Jun 11 16:58:04.061374 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:04.061347 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:58:04.061435 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:04.061417 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:58:04.061489 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:04.061473 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:58:05.068367 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:05.068329 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" event={"ID":"158ef541-0a86-4052-968b-4df7854a2445","Type":"ContainerStarted","Data":"73d8106a3b154c7d98d0e098eebcd3b0f03d25ebe3f1befe7c251267522a2277"} Jun 11 16:58:05.997574 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:05.997531 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:58:05.998220 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:05.998191 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-cj886 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jun 11 16:58:05.998279 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:05.998257 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" podUID="158ef541-0a86-4052-968b-4df7854a2445" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jun 11 16:58:06.997423 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:06.997384 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-cj886 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jun 11 16:58:06.998020 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:06.997977 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" podUID="158ef541-0a86-4052-968b-4df7854a2445" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jun 11 16:58:07.997772 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:07.997730 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-cj886 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jun 11 16:58:07.998167 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:07.997794 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" podUID="158ef541-0a86-4052-968b-4df7854a2445" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jun 11 16:58:08.997143 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:08.997103 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-cj886 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jun 11 16:58:08.997438 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:08.997406 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" podUID="158ef541-0a86-4052-968b-4df7854a2445" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jun 11 16:58:10.001021 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:10.000988 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:58:10.001408 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:10.001312 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:58:10.002110 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:58:10.002091 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-cj886" Jun 11 16:59:07.523499 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:59:07.523474 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 16:59:07.525372 ip-10-0-129-76 kubenswrapper[2580]: I0611 16:59:07.525349 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 17:00:00.211539 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:00.211502 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-6wclg"] Jun 11 17:00:00.214857 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:00.214839 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" Jun 11 17:00:00.218931 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:00.218910 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-v6xgm\"" Jun 11 17:00:00.320107 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:00.320076 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-6wclg"] Jun 11 17:00:00.386613 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:00.386570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lkmr\" (UniqueName: \"kubernetes.io/projected/532388ab-fb41-41a4-9be6-bf21271d2b0a-kube-api-access-5lkmr\") pod \"maas-api-key-cleanup-29686620-6wclg\" (UID: \"532388ab-fb41-41a4-9be6-bf21271d2b0a\") " pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" Jun 11 17:00:00.487669 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:00.487588 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lkmr\" (UniqueName: \"kubernetes.io/projected/532388ab-fb41-41a4-9be6-bf21271d2b0a-kube-api-access-5lkmr\") pod \"maas-api-key-cleanup-29686620-6wclg\" (UID: \"532388ab-fb41-41a4-9be6-bf21271d2b0a\") " pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" Jun 11 17:00:00.506153 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:00.506121 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lkmr\" (UniqueName: \"kubernetes.io/projected/532388ab-fb41-41a4-9be6-bf21271d2b0a-kube-api-access-5lkmr\") pod \"maas-api-key-cleanup-29686620-6wclg\" (UID: \"532388ab-fb41-41a4-9be6-bf21271d2b0a\") " pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" Jun 11 17:00:00.525181 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:00.525146 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" Jun 11 17:00:00.692052 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:00.692012 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-6wclg"] Jun 11 17:00:00.694482 ip-10-0-129-76 kubenswrapper[2580]: W0611 17:00:00.694434 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532388ab_fb41_41a4_9be6_bf21271d2b0a.slice/crio-9fd333a548b0e151af9a3cbead050752d0821ad34d64e7d1b11984fa416cae5e WatchSource:0}: Error finding container 9fd333a548b0e151af9a3cbead050752d0821ad34d64e7d1b11984fa416cae5e: Status 404 returned error can't find the container with id 9fd333a548b0e151af9a3cbead050752d0821ad34d64e7d1b11984fa416cae5e Jun 11 17:00:00.696280 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:00.696254 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:00:01.697722 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:01.697687 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" event={"ID":"532388ab-fb41-41a4-9be6-bf21271d2b0a","Type":"ContainerStarted","Data":"9fd333a548b0e151af9a3cbead050752d0821ad34d64e7d1b11984fa416cae5e"} Jun 11 17:00:14.770406 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:14.770368 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" event={"ID":"532388ab-fb41-41a4-9be6-bf21271d2b0a","Type":"ContainerStarted","Data":"5e848a44e59d5c7d6d169c80219cb8431ce4bd01c944462981756113a24b2e60"} Jun 11 17:00:14.800311 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:14.800251 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" podStartSLOduration=1.492072336 podStartE2EDuration="14.80023577s" totalImagesPullingTime="13.308163434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:00:14.795853188 +0000 UTC m=+967.774328717" watchObservedRunningTime="2026-06-11 17:00:14.80023577 +0000 UTC m=+967.778711298" Jun 11 17:00:15.777071 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:15.777038 2580 generic.go:356] "Generic (PLEG): container finished" podID="532388ab-fb41-41a4-9be6-bf21271d2b0a" containerID="5e848a44e59d5c7d6d169c80219cb8431ce4bd01c944462981756113a24b2e60" exitCode=0 Jun 11 17:00:15.777473 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:15.777124 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" event={"ID":"532388ab-fb41-41a4-9be6-bf21271d2b0a","Type":"ContainerDied","Data":"5e848a44e59d5c7d6d169c80219cb8431ce4bd01c944462981756113a24b2e60"} Jun 11 17:00:16.912087 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:16.912063 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" Jun 11 17:00:16.925108 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:16.925086 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lkmr\" (UniqueName: \"kubernetes.io/projected/532388ab-fb41-41a4-9be6-bf21271d2b0a-kube-api-access-5lkmr\") pod \"532388ab-fb41-41a4-9be6-bf21271d2b0a\" (UID: \"532388ab-fb41-41a4-9be6-bf21271d2b0a\") " Jun 11 17:00:16.927365 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:16.927310 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/532388ab-fb41-41a4-9be6-bf21271d2b0a-kube-api-access-5lkmr" (OuterVolumeSpecName: "kube-api-access-5lkmr") pod "532388ab-fb41-41a4-9be6-bf21271d2b0a" (UID: "532388ab-fb41-41a4-9be6-bf21271d2b0a"). InnerVolumeSpecName "kube-api-access-5lkmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:00:17.026398 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:17.026363 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lkmr\" (UniqueName: \"kubernetes.io/projected/532388ab-fb41-41a4-9be6-bf21271d2b0a-kube-api-access-5lkmr\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:00:17.790315 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:17.790228 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" event={"ID":"532388ab-fb41-41a4-9be6-bf21271d2b0a","Type":"ContainerDied","Data":"9fd333a548b0e151af9a3cbead050752d0821ad34d64e7d1b11984fa416cae5e"} Jun 11 17:00:17.790315 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:17.790263 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-6wclg" Jun 11 17:00:17.790315 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:00:17.790285 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fd333a548b0e151af9a3cbead050752d0821ad34d64e7d1b11984fa416cae5e" Jun 11 17:04:07.558637 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:04:07.558605 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 17:04:07.563783 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:04:07.563565 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 17:09:07.601430 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:09:07.601400 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 17:09:07.606641 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:09:07.606622 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 17:14:07.638111 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:14:07.638087 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 17:14:07.651557 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:14:07.651530 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 17:15:00.204028 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.203983 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686635-9t5d5"] Jun 11 17:15:00.204683 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.204552 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="532388ab-fb41-41a4-9be6-bf21271d2b0a" containerName="cleanup" Jun 11 17:15:00.204683 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.204572 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="532388ab-fb41-41a4-9be6-bf21271d2b0a" containerName="cleanup" Jun 11 17:15:00.204683 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.204665 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="532388ab-fb41-41a4-9be6-bf21271d2b0a" containerName="cleanup" Jun 11 17:15:00.207651 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.207630 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" Jun 11 17:15:00.211122 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.211101 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-v6xgm\"" Jun 11 17:15:00.240724 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.240699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7jx8\" (UniqueName: \"kubernetes.io/projected/31c39b29-503d-4a88-94c7-1b1e883bf409-kube-api-access-k7jx8\") pod \"maas-api-key-cleanup-29686635-9t5d5\" (UID: \"31c39b29-503d-4a88-94c7-1b1e883bf409\") " pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" Jun 11 17:15:00.256472 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.256430 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686635-9t5d5"] Jun 11 17:15:00.341683 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.341657 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7jx8\" (UniqueName: \"kubernetes.io/projected/31c39b29-503d-4a88-94c7-1b1e883bf409-kube-api-access-k7jx8\") pod \"maas-api-key-cleanup-29686635-9t5d5\" (UID: \"31c39b29-503d-4a88-94c7-1b1e883bf409\") " pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" Jun 11 17:15:00.362784 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.362756 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7jx8\" (UniqueName: \"kubernetes.io/projected/31c39b29-503d-4a88-94c7-1b1e883bf409-kube-api-access-k7jx8\") pod \"maas-api-key-cleanup-29686635-9t5d5\" (UID: \"31c39b29-503d-4a88-94c7-1b1e883bf409\") " pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" Jun 11 17:15:00.517872 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.517806 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" Jun 11 17:15:00.665898 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:00.665871 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686635-9t5d5"] Jun 11 17:15:00.668049 ip-10-0-129-76 kubenswrapper[2580]: W0611 17:15:00.668018 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c39b29_503d_4a88_94c7_1b1e883bf409.slice/crio-9340e2e7081e1c8c444d178aff5456a7c2f1ee1ac1317b8ccf107926af1f4d51 WatchSource:0}: Error finding container 9340e2e7081e1c8c444d178aff5456a7c2f1ee1ac1317b8ccf107926af1f4d51: Status 404 returned error can't find the container with id 9340e2e7081e1c8c444d178aff5456a7c2f1ee1ac1317b8ccf107926af1f4d51 Jun 11 17:15:01.545199 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:01.545164 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" event={"ID":"31c39b29-503d-4a88-94c7-1b1e883bf409","Type":"ContainerStarted","Data":"2434eb46545123dd943275aa4aee89ca37a72f84a6756ff61cbd070ff2391be7"} Jun 11 17:15:01.545593 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:01.545210 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" event={"ID":"31c39b29-503d-4a88-94c7-1b1e883bf409","Type":"ContainerStarted","Data":"9340e2e7081e1c8c444d178aff5456a7c2f1ee1ac1317b8ccf107926af1f4d51"} Jun 11 17:15:01.567397 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:01.567350 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" podStartSLOduration=1.5673350529999999 podStartE2EDuration="1.567335053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:15:01.56553235 +0000 UTC m=+1854.544007879" watchObservedRunningTime="2026-06-11 17:15:01.567335053 +0000 UTC m=+1854.545810582" Jun 11 17:15:02.552306 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:02.552266 2580 generic.go:356] "Generic (PLEG): container finished" podID="31c39b29-503d-4a88-94c7-1b1e883bf409" containerID="2434eb46545123dd943275aa4aee89ca37a72f84a6756ff61cbd070ff2391be7" exitCode=0 Jun 11 17:15:02.552721 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:02.552356 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" event={"ID":"31c39b29-503d-4a88-94c7-1b1e883bf409","Type":"ContainerDied","Data":"2434eb46545123dd943275aa4aee89ca37a72f84a6756ff61cbd070ff2391be7"} Jun 11 17:15:03.687572 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:03.687548 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" Jun 11 17:15:03.772365 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:03.772338 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7jx8\" (UniqueName: \"kubernetes.io/projected/31c39b29-503d-4a88-94c7-1b1e883bf409-kube-api-access-k7jx8\") pod \"31c39b29-503d-4a88-94c7-1b1e883bf409\" (UID: \"31c39b29-503d-4a88-94c7-1b1e883bf409\") " Jun 11 17:15:03.774631 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:03.774608 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c39b29-503d-4a88-94c7-1b1e883bf409-kube-api-access-k7jx8" (OuterVolumeSpecName: "kube-api-access-k7jx8") pod "31c39b29-503d-4a88-94c7-1b1e883bf409" (UID: "31c39b29-503d-4a88-94c7-1b1e883bf409"). InnerVolumeSpecName "kube-api-access-k7jx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:15:03.873184 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:03.873149 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7jx8\" (UniqueName: \"kubernetes.io/projected/31c39b29-503d-4a88-94c7-1b1e883bf409-kube-api-access-k7jx8\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:15:04.563557 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:04.563527 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" Jun 11 17:15:04.563721 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:04.563574 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686635-9t5d5" event={"ID":"31c39b29-503d-4a88-94c7-1b1e883bf409","Type":"ContainerDied","Data":"9340e2e7081e1c8c444d178aff5456a7c2f1ee1ac1317b8ccf107926af1f4d51"} Jun 11 17:15:04.563721 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:15:04.563618 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9340e2e7081e1c8c444d178aff5456a7c2f1ee1ac1317b8ccf107926af1f4d51" Jun 11 17:19:07.681515 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:19:07.681398 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 17:19:07.688404 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:19:07.688386 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 17:24:07.717221 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:24:07.717121 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 17:24:07.724912 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:24:07.724888 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd85h_fb9c02ea-368b-4b3b-8de1-6930d11884c3/ovn-acl-logging/0.log" Jun 11 17:26:14.613391 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.613354 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj"] Jun 11 17:26:14.613779 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.613716 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c39b29-503d-4a88-94c7-1b1e883bf409" containerName="cleanup" Jun 11 17:26:14.613779 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.613727 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c39b29-503d-4a88-94c7-1b1e883bf409" containerName="cleanup" Jun 11 17:26:14.613848 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.613785 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="31c39b29-503d-4a88-94c7-1b1e883bf409" containerName="cleanup" Jun 11 17:26:14.616673 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.616658 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.621238 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.621219 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6eda0e59-openshift-default-dockercfg-m48l4\"" Jun 11 17:26:14.645222 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.645198 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istiod-ca-cert\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.645319 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.645230 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-certs\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.645319 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.645253 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-socket\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.645319 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.645271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-data\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.645495 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.645322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-credential-socket\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.645495 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.645340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-envoy\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.645495 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.645355 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpnnh\" (UniqueName: \"kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-kube-api-access-kpnnh\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.645649 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.645483 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-podinfo\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.645649 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.645584 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-token\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.654235 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.654213 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj"] Jun 11 17:26:14.746616 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.746581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-credential-socket\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.746616 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.746615 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-envoy\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.746851 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.746632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnnh\" (UniqueName: \"kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-kube-api-access-kpnnh\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.746851 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.746659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-podinfo\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.746851 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.746698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-token\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.746851 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.746731 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istiod-ca-cert\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.746851 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.746759 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-certs\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.746851 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.746791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-socket\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.746851 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.746814 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-data\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.747168 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.747038 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-credential-socket\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.747168 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.747133 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-data\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.747306 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.747283 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-socket\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.747441 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.747421 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istiod-ca-cert\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.747709 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.747687 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-certs\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.749088 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.749069 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-envoy\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.749217 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.749200 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-podinfo\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.799935 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.799909 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpnnh\" (UniqueName: \"kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-kube-api-access-kpnnh\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.801899 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.801876 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-token\") pod \"e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:14.927112 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:14.927086 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:15.083332 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:15.083300 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj"] Jun 11 17:26:15.098869 ip-10-0-129-76 kubenswrapper[2580]: W0611 17:26:15.098841 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10762a2b_96c2_4128_8ec6_1ab70b9d06a1.slice/crio-a245300f39423770bed2167e729ea16ee68c8ea380f28cca9e8fcf6f4a78e34a WatchSource:0}: Error finding container a245300f39423770bed2167e729ea16ee68c8ea380f28cca9e8fcf6f4a78e34a: Status 404 returned error can't find the container with id a245300f39423770bed2167e729ea16ee68c8ea380f28cca9e8fcf6f4a78e34a Jun 11 17:26:15.100873 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:15.100832 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 17:26:15.100974 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:15.100910 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 17:26:15.100974 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:15.100959 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 17:26:15.171548 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:15.171513 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" event={"ID":"10762a2b-96c2-4128-8ec6-1ab70b9d06a1","Type":"ContainerStarted","Data":"e8acddf2a1ce5de976a390d3333324d63137e349a892cca0292cf799219a623b"} Jun 11 17:26:15.171647 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:15.171563 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" event={"ID":"10762a2b-96c2-4128-8ec6-1ab70b9d06a1","Type":"ContainerStarted","Data":"a245300f39423770bed2167e729ea16ee68c8ea380f28cca9e8fcf6f4a78e34a"} Jun 11 17:26:15.214703 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:15.214612 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" podStartSLOduration=1.214597244 podStartE2EDuration="1.214597244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:26:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:26:15.213557174 +0000 UTC m=+2528.192032703" watchObservedRunningTime="2026-06-11 17:26:15.214597244 +0000 UTC m=+2528.193072773" Jun 11 17:26:15.927483 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:15.927425 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:16.932034 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:16.932006 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:17.182916 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:17.182822 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:17.183692 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:17.183672 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:20.986815 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:20.986780 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj"] Jun 11 17:26:20.987290 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:20.986959 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" podUID="10762a2b-96c2-4128-8ec6-1ab70b9d06a1" containerName="istio-proxy" containerID="cri-o://e8acddf2a1ce5de976a390d3333324d63137e349a892cca0292cf799219a623b" gracePeriod=30 Jun 11 17:26:26.231835 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.231803 2580 generic.go:356] "Generic (PLEG): container finished" podID="10762a2b-96c2-4128-8ec6-1ab70b9d06a1" containerID="e8acddf2a1ce5de976a390d3333324d63137e349a892cca0292cf799219a623b" exitCode=0 Jun 11 17:26:26.232178 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.231884 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" event={"ID":"10762a2b-96c2-4128-8ec6-1ab70b9d06a1","Type":"ContainerDied","Data":"e8acddf2a1ce5de976a390d3333324d63137e349a892cca0292cf799219a623b"} Jun 11 17:26:26.232178 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.231941 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" event={"ID":"10762a2b-96c2-4128-8ec6-1ab70b9d06a1","Type":"ContainerDied","Data":"a245300f39423770bed2167e729ea16ee68c8ea380f28cca9e8fcf6f4a78e34a"} Jun 11 17:26:26.232178 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.231964 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a245300f39423770bed2167e729ea16ee68c8ea380f28cca9e8fcf6f4a78e34a" Jun 11 17:26:26.234726 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.234710 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:26.340627 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.340564 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-token\") pod \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " Jun 11 17:26:26.340627 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.340597 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-certs\") pod \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " Jun 11 17:26:26.340627 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.340622 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istiod-ca-cert\") pod \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " Jun 11 17:26:26.340846 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.340661 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-socket\") pod \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " Jun 11 17:26:26.340846 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.340679 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-data\") pod \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " Jun 11 17:26:26.340846 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.340697 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-envoy\") pod \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " Jun 11 17:26:26.340846 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.340723 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-credential-socket\") pod \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " Jun 11 17:26:26.340846 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.340758 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpnnh\" (UniqueName: \"kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-kube-api-access-kpnnh\") pod \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " Jun 11 17:26:26.341086 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.340869 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10762a2b-96c2-4128-8ec6-1ab70b9d06a1" (UID: "10762a2b-96c2-4128-8ec6-1ab70b9d06a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:26:26.341086 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.340938 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "10762a2b-96c2-4128-8ec6-1ab70b9d06a1" (UID: "10762a2b-96c2-4128-8ec6-1ab70b9d06a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:26:26.341086 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.340992 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10762a2b-96c2-4128-8ec6-1ab70b9d06a1" (UID: "10762a2b-96c2-4128-8ec6-1ab70b9d06a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:26:26.341086 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.341003 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10762a2b-96c2-4128-8ec6-1ab70b9d06a1" (UID: "10762a2b-96c2-4128-8ec6-1ab70b9d06a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:26:26.341265 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.341088 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-podinfo\") pod \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\" (UID: \"10762a2b-96c2-4128-8ec6-1ab70b9d06a1\") " Jun 11 17:26:26.341265 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.341136 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10762a2b-96c2-4128-8ec6-1ab70b9d06a1" (UID: "10762a2b-96c2-4128-8ec6-1ab70b9d06a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:26:26.341368 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.341350 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-certs\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:26.341431 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.341375 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istiod-ca-cert\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:26.341431 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.341387 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-workload-socket\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:26.341431 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.341396 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-data\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:26.341431 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.341409 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-credential-socket\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:26.343061 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.343040 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "10762a2b-96c2-4128-8ec6-1ab70b9d06a1" (UID: "10762a2b-96c2-4128-8ec6-1ab70b9d06a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:26:26.343172 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.343123 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10762a2b-96c2-4128-8ec6-1ab70b9d06a1" (UID: "10762a2b-96c2-4128-8ec6-1ab70b9d06a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 17:26:26.343462 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.343426 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-kube-api-access-kpnnh" (OuterVolumeSpecName: "kube-api-access-kpnnh") pod "10762a2b-96c2-4128-8ec6-1ab70b9d06a1" (UID: "10762a2b-96c2-4128-8ec6-1ab70b9d06a1"). InnerVolumeSpecName "kube-api-access-kpnnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:26:26.343520 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.343421 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10762a2b-96c2-4128-8ec6-1ab70b9d06a1" (UID: "10762a2b-96c2-4128-8ec6-1ab70b9d06a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:26:26.442721 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.442699 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-podinfo\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:26.442721 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.442719 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-token\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:26.442849 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.442727 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-istio-envoy\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:26.442849 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:26.442735 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpnnh\" (UniqueName: \"kubernetes.io/projected/10762a2b-96c2-4128-8ec6-1ab70b9d06a1-kube-api-access-kpnnh\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:27.236965 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.236925 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj" Jun 11 17:26:27.260529 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.260498 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj"] Jun 11 17:26:27.271592 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.271562 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6eda0e59-openshift-default-78fb6cc964-d5lnj"] Jun 11 17:26:27.522239 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.522165 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10762a2b-96c2-4128-8ec6-1ab70b9d06a1" path="/var/lib/kubelet/pods/10762a2b-96c2-4128-8ec6-1ab70b9d06a1/volumes" Jun 11 17:26:27.554231 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.554199 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn"] Jun 11 17:26:27.554587 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.554573 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10762a2b-96c2-4128-8ec6-1ab70b9d06a1" containerName="istio-proxy" Jun 11 17:26:27.554645 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.554589 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="10762a2b-96c2-4128-8ec6-1ab70b9d06a1" containerName="istio-proxy" Jun 11 17:26:27.554681 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.554649 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="10762a2b-96c2-4128-8ec6-1ab70b9d06a1" containerName="istio-proxy" Jun 11 17:26:27.558965 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.558941 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.561966 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.561943 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ad832ec1-openshift-default-dockercfg-clzfx\"" Jun 11 17:26:27.588761 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.588734 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn"] Jun 11 17:26:27.652015 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.651981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-certs\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.652175 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.652016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz9wd\" (UniqueName: \"kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-kube-api-access-cz9wd\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.652253 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.652177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/415642e5-ccf6-4737-982a-66ce6165cf4f-istiod-ca-cert\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.652253 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.652234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-podinfo\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.652436 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.652389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-credential-socket\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.652557 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.652477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-data\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.652557 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.652536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-token\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.652731 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.652706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-envoy\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.652843 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.652742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-socket\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754107 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-envoy\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754107 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754109 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-socket\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754357 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754145 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-certs\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754357 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz9wd\" (UniqueName: \"kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-kube-api-access-cz9wd\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754357 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/415642e5-ccf6-4737-982a-66ce6165cf4f-istiod-ca-cert\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754357 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-podinfo\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754357 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-credential-socket\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754357 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754318 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-data\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754700 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-token\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754700 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754562 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-socket\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754792 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754696 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-credential-socket\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754854 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754833 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-data\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.754908 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.754887 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-certs\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.755019 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.755001 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/415642e5-ccf6-4737-982a-66ce6165cf4f-istiod-ca-cert\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.756778 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.756757 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-envoy\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.756956 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.756938 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-podinfo\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.776346 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.776285 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-token\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.777234 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.777216 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz9wd\" (UniqueName: \"kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-kube-api-access-cz9wd\") pod \"e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:27.869501 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:27.869478 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:28.016354 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:28.016327 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn"] Jun 11 17:26:28.017548 ip-10-0-129-76 kubenswrapper[2580]: W0611 17:26:28.017523 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415642e5_ccf6_4737_982a_66ce6165cf4f.slice/crio-3ec0b29498f31d5bf596a2027c843bd3efd537b0368585c17305b0c95c775c84 WatchSource:0}: Error finding container 3ec0b29498f31d5bf596a2027c843bd3efd537b0368585c17305b0c95c775c84: Status 404 returned error can't find the container with id 3ec0b29498f31d5bf596a2027c843bd3efd537b0368585c17305b0c95c775c84 Jun 11 17:26:28.019593 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:28.019556 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 17:26:28.019644 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:28.019628 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 17:26:28.019681 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:28.019662 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 17:26:28.246856 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:28.246819 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" event={"ID":"415642e5-ccf6-4737-982a-66ce6165cf4f","Type":"ContainerStarted","Data":"8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576"} Jun 11 17:26:28.247306 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:28.246883 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" event={"ID":"415642e5-ccf6-4737-982a-66ce6165cf4f","Type":"ContainerStarted","Data":"3ec0b29498f31d5bf596a2027c843bd3efd537b0368585c17305b0c95c775c84"} Jun 11 17:26:28.300853 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:28.300760 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" podStartSLOduration=1.300745698 podStartE2EDuration="1.300745698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:26:28.298716057 +0000 UTC m=+2541.277191587" watchObservedRunningTime="2026-06-11 17:26:28.300745698 +0000 UTC m=+2541.279221227" Jun 11 17:26:28.870126 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:28.870093 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:29.875182 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:29.875149 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:30.258685 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:30.258586 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:30.259580 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:30.259557 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:35.000539 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:35.000504 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn"] Jun 11 17:26:35.000928 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:35.000674 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" podUID="415642e5-ccf6-4737-982a-66ce6165cf4f" containerName="istio-proxy" containerID="cri-o://8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576" gracePeriod=30 Jun 11 17:26:40.267880 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.267809 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:40.314273 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.314232 2580 generic.go:356] "Generic (PLEG): container finished" podID="415642e5-ccf6-4737-982a-66ce6165cf4f" containerID="8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576" exitCode=0 Jun 11 17:26:40.314478 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.314282 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" Jun 11 17:26:40.314478 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.314301 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" event={"ID":"415642e5-ccf6-4737-982a-66ce6165cf4f","Type":"ContainerDied","Data":"8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576"} Jun 11 17:26:40.314478 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.314351 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn" event={"ID":"415642e5-ccf6-4737-982a-66ce6165cf4f","Type":"ContainerDied","Data":"3ec0b29498f31d5bf596a2027c843bd3efd537b0368585c17305b0c95c775c84"} Jun 11 17:26:40.314478 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.314375 2580 scope.go:117] "RemoveContainer" containerID="8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576" Jun 11 17:26:40.323565 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.323544 2580 scope.go:117] "RemoveContainer" containerID="8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576" Jun 11 17:26:40.323813 ip-10-0-129-76 kubenswrapper[2580]: E0611 17:26:40.323797 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576\": container with ID starting with 8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576 not found: ID does not exist" containerID="8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576" Jun 11 17:26:40.323878 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.323826 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576"} err="failed to get container status \"8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576\": rpc error: code = NotFound desc = could not find container \"8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576\": container with ID starting with 8d576494bb17769bef83844444f9d10e5191b936fd49ab3e10949e4f7ce30576 not found: ID does not exist" Jun 11 17:26:40.360598 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.360571 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-token\") pod \"415642e5-ccf6-4737-982a-66ce6165cf4f\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " Jun 11 17:26:40.360705 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.360602 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-socket\") pod \"415642e5-ccf6-4737-982a-66ce6165cf4f\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " Jun 11 17:26:40.360705 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.360647 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-podinfo\") pod \"415642e5-ccf6-4737-982a-66ce6165cf4f\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " Jun 11 17:26:40.360705 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.360668 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/415642e5-ccf6-4737-982a-66ce6165cf4f-istiod-ca-cert\") pod \"415642e5-ccf6-4737-982a-66ce6165cf4f\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " Jun 11 17:26:40.360705 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.360687 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-certs\") pod \"415642e5-ccf6-4737-982a-66ce6165cf4f\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " Jun 11 17:26:40.360925 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.360716 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz9wd\" (UniqueName: \"kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-kube-api-access-cz9wd\") pod \"415642e5-ccf6-4737-982a-66ce6165cf4f\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " Jun 11 17:26:40.360925 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.360743 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-envoy\") pod \"415642e5-ccf6-4737-982a-66ce6165cf4f\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " Jun 11 17:26:40.360925 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.360782 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-data\") pod \"415642e5-ccf6-4737-982a-66ce6165cf4f\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " Jun 11 17:26:40.360925 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.360812 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-credential-socket\") pod \"415642e5-ccf6-4737-982a-66ce6165cf4f\" (UID: \"415642e5-ccf6-4737-982a-66ce6165cf4f\") " Jun 11 17:26:40.360925 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.360877 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "415642e5-ccf6-4737-982a-66ce6165cf4f" (UID: "415642e5-ccf6-4737-982a-66ce6165cf4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:26:40.361228 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.361040 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "415642e5-ccf6-4737-982a-66ce6165cf4f" (UID: "415642e5-ccf6-4737-982a-66ce6165cf4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:26:40.361228 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.361085 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-socket\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:40.361228 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.361153 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/415642e5-ccf6-4737-982a-66ce6165cf4f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "415642e5-ccf6-4737-982a-66ce6165cf4f" (UID: "415642e5-ccf6-4737-982a-66ce6165cf4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:26:40.361589 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.361254 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "415642e5-ccf6-4737-982a-66ce6165cf4f" (UID: "415642e5-ccf6-4737-982a-66ce6165cf4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:26:40.361589 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.361421 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-data" (OuterVolumeSpecName: "istio-data") pod "415642e5-ccf6-4737-982a-66ce6165cf4f" (UID: "415642e5-ccf6-4737-982a-66ce6165cf4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:26:40.362997 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.362962 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-token" (OuterVolumeSpecName: "istio-token") pod "415642e5-ccf6-4737-982a-66ce6165cf4f" (UID: "415642e5-ccf6-4737-982a-66ce6165cf4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:26:40.363100 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.363028 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "415642e5-ccf6-4737-982a-66ce6165cf4f" (UID: "415642e5-ccf6-4737-982a-66ce6165cf4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 17:26:40.363545 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.363519 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "415642e5-ccf6-4737-982a-66ce6165cf4f" (UID: "415642e5-ccf6-4737-982a-66ce6165cf4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:26:40.363626 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.363545 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-kube-api-access-cz9wd" (OuterVolumeSpecName: "kube-api-access-cz9wd") pod "415642e5-ccf6-4737-982a-66ce6165cf4f" (UID: "415642e5-ccf6-4737-982a-66ce6165cf4f"). InnerVolumeSpecName "kube-api-access-cz9wd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:26:40.461511 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.461482 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-token\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:40.461511 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.461507 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-podinfo\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:40.461511 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.461515 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/415642e5-ccf6-4737-982a-66ce6165cf4f-istiod-ca-cert\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:40.461734 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.461523 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-workload-certs\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:40.461734 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.461531 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz9wd\" (UniqueName: \"kubernetes.io/projected/415642e5-ccf6-4737-982a-66ce6165cf4f-kube-api-access-cz9wd\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:40.461734 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.461541 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-envoy\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:40.461734 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.461548 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-istio-data\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:40.461734 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.461556 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/415642e5-ccf6-4737-982a-66ce6165cf4f-credential-socket\") on node \"ip-10-0-129-76.ec2.internal\" DevicePath \"\"" Jun 11 17:26:40.638108 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.638084 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn"] Jun 11 17:26:40.642367 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:40.642342 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ad832ec1-openshift-default-755794bdb8-647dn"] Jun 11 17:26:41.522360 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:41.522330 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="415642e5-ccf6-4737-982a-66ce6165cf4f" path="/var/lib/kubelet/pods/415642e5-ccf6-4737-982a-66ce6165cf4f/volumes" Jun 11 17:26:53.327242 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:53.327214 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6879556547-5kjm6_a654fc02-c562-4021-a93b-2aa0d016d2e9/nginx/0.log" Jun 11 17:26:53.926469 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:53.926429 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686620-6wclg_532388ab-fb41-41a4-9be6-bf21271d2b0a/cleanup/0.log" Jun 11 17:26:54.036112 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:54.036086 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686635-9t5d5_31c39b29-503d-4a88-94c7-1b1e883bf409/cleanup/0.log" Jun 11 17:26:54.638116 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:54.638087 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f54898884-n9jn2_8c128f70-8b95-453e-84d1-03769c16daa1/copy-manifests/0.log" Jun 11 17:26:54.649971 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:54.649943 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f54898884-n9jn2_8c128f70-8b95-453e-84d1-03769c16daa1/manager/0.log" Jun 11 17:26:54.906653 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:54.906579 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-w4vtq_f720755d-11cc-4a4a-b124-5b11d42ff875/postgres/0.log" Jun 11 17:26:55.672075 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:55.672042 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4_d64550a0-5c48-4803-9de3-36c77f8576ea/util/0.log" Jun 11 17:26:55.679891 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:55.679867 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4_d64550a0-5c48-4803-9de3-36c77f8576ea/pull/0.log" Jun 11 17:26:55.692797 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:55.692779 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4_d64550a0-5c48-4803-9de3-36c77f8576ea/extract/0.log" Jun 11 17:26:55.803746 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:55.803720 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh_5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5/util/0.log" Jun 11 17:26:55.813881 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:55.813857 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh_5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5/pull/0.log" Jun 11 17:26:55.822465 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:55.822430 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh_5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5/extract/0.log" Jun 11 17:26:55.932032 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:55.931969 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj_722101c5-4f4f-465d-b9dd-166004a3ef4c/extract/0.log" Jun 11 17:26:55.940314 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:55.940294 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj_722101c5-4f4f-465d-b9dd-166004a3ef4c/util/0.log" Jun 11 17:26:55.947971 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:55.947936 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj_722101c5-4f4f-465d-b9dd-166004a3ef4c/pull/0.log" Jun 11 17:26:56.060391 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:56.060367 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq_4be8a280-e763-406e-9fdf-15aed9cacbd7/pull/0.log" Jun 11 17:26:56.072955 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:56.072938 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq_4be8a280-e763-406e-9fdf-15aed9cacbd7/extract/0.log" Jun 11 17:26:56.080351 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:56.080331 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq_4be8a280-e763-406e-9fdf-15aed9cacbd7/util/0.log" Jun 11 17:26:56.331023 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:56.330934 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vsk8p_320c5f0b-8864-4385-becc-579dade89a90/manager/0.log" Jun 11 17:26:56.685919 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:56.685890 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rz6jj_7ad17bc1-7b58-4a83-acc7-578c8b1b94f0/registry-server/0.log" Jun 11 17:26:57.394741 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:57.394710 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mhgjf_18220b0b-b691-403a-9493-eaa632bcbe6e/istio-proxy/0.log" Jun 11 17:26:57.883353 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:26:57.883322 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-cj886_158ef541-0a86-4052-968b-4df7854a2445/istio-proxy/1.log" Jun 11 17:27:03.784042 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.784006 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7wbff/must-gather-xlts8"] Jun 11 17:27:03.784403 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.784345 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415642e5-ccf6-4737-982a-66ce6165cf4f" containerName="istio-proxy" Jun 11 17:27:03.784403 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.784357 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="415642e5-ccf6-4737-982a-66ce6165cf4f" containerName="istio-proxy" Jun 11 17:27:03.784509 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.784430 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="415642e5-ccf6-4737-982a-66ce6165cf4f" containerName="istio-proxy" Jun 11 17:27:03.787553 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.787536 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7wbff/must-gather-xlts8" Jun 11 17:27:03.790063 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.790027 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7wbff\"/\"openshift-service-ca.crt\"" Jun 11 17:27:03.790063 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.790053 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7wbff\"/\"kube-root-ca.crt\"" Jun 11 17:27:03.790852 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.790831 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7wbff\"/\"default-dockercfg-wqlrp\"" Jun 11 17:27:03.800758 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.800737 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7wbff/must-gather-xlts8"] Jun 11 17:27:03.856272 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.856242 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4lmq\" (UniqueName: \"kubernetes.io/projected/7a333c28-f47a-4b4e-b1a9-f520c6ae4782-kube-api-access-g4lmq\") pod \"must-gather-xlts8\" (UID: \"7a333c28-f47a-4b4e-b1a9-f520c6ae4782\") " pod="openshift-must-gather-7wbff/must-gather-xlts8" Jun 11 17:27:03.856383 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.856318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7a333c28-f47a-4b4e-b1a9-f520c6ae4782-must-gather-output\") pod \"must-gather-xlts8\" (UID: \"7a333c28-f47a-4b4e-b1a9-f520c6ae4782\") " pod="openshift-must-gather-7wbff/must-gather-xlts8" Jun 11 17:27:03.957000 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.956973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4lmq\" (UniqueName: \"kubernetes.io/projected/7a333c28-f47a-4b4e-b1a9-f520c6ae4782-kube-api-access-g4lmq\") pod \"must-gather-xlts8\" (UID: \"7a333c28-f47a-4b4e-b1a9-f520c6ae4782\") " pod="openshift-must-gather-7wbff/must-gather-xlts8" Jun 11 17:27:03.957110 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.957011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7a333c28-f47a-4b4e-b1a9-f520c6ae4782-must-gather-output\") pod \"must-gather-xlts8\" (UID: \"7a333c28-f47a-4b4e-b1a9-f520c6ae4782\") " pod="openshift-must-gather-7wbff/must-gather-xlts8" Jun 11 17:27:03.957302 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.957285 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7a333c28-f47a-4b4e-b1a9-f520c6ae4782-must-gather-output\") pod \"must-gather-xlts8\" (UID: \"7a333c28-f47a-4b4e-b1a9-f520c6ae4782\") " pod="openshift-must-gather-7wbff/must-gather-xlts8" Jun 11 17:27:03.968332 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:03.968310 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4lmq\" (UniqueName: \"kubernetes.io/projected/7a333c28-f47a-4b4e-b1a9-f520c6ae4782-kube-api-access-g4lmq\") pod \"must-gather-xlts8\" (UID: \"7a333c28-f47a-4b4e-b1a9-f520c6ae4782\") " pod="openshift-must-gather-7wbff/must-gather-xlts8" Jun 11 17:27:04.097084 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:04.097023 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7wbff/must-gather-xlts8" Jun 11 17:27:04.245850 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:04.245810 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7wbff/must-gather-xlts8"] Jun 11 17:27:04.248073 ip-10-0-129-76 kubenswrapper[2580]: W0611 17:27:04.248044 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a333c28_f47a_4b4e_b1a9_f520c6ae4782.slice/crio-2675faca7be6860f502044d1e0f7313ce5ced8ed829e81ee94172c00ba4b4f2e WatchSource:0}: Error finding container 2675faca7be6860f502044d1e0f7313ce5ced8ed829e81ee94172c00ba4b4f2e: Status 404 returned error can't find the container with id 2675faca7be6860f502044d1e0f7313ce5ced8ed829e81ee94172c00ba4b4f2e Jun 11 17:27:04.249955 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:04.249938 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:27:04.446008 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:04.445978 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7wbff/must-gather-xlts8" event={"ID":"7a333c28-f47a-4b4e-b1a9-f520c6ae4782","Type":"ContainerStarted","Data":"2675faca7be6860f502044d1e0f7313ce5ced8ed829e81ee94172c00ba4b4f2e"} Jun 11 17:27:05.462519 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:05.462439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7wbff/must-gather-xlts8" event={"ID":"7a333c28-f47a-4b4e-b1a9-f520c6ae4782","Type":"ContainerStarted","Data":"0393ff5908af6035726a54b4c21218232ae3d6a9ca90c6fe6b6c1e57f99796aa"} Jun 11 17:27:06.475750 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:06.475711 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7wbff/must-gather-xlts8" event={"ID":"7a333c28-f47a-4b4e-b1a9-f520c6ae4782","Type":"ContainerStarted","Data":"c3f61fa675ad72e3ca9fbf69a24356dd7e7815e990a73f5741d11326e439e986"} Jun 11 17:27:06.505783 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:06.505706 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7wbff/must-gather-xlts8" podStartSLOduration=2.426217401 podStartE2EDuration="3.505683034s" totalImagesPullingTime="1.079465633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:27:06.504143952 +0000 UTC m=+2579.482619481" watchObservedRunningTime="2026-06-11 17:27:06.505683034 +0000 UTC m=+2579.484158565" Jun 11 17:27:07.354706 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:07.354667 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k79r4_822c473e-85e5-4340-8473-ad3f7f993dda/global-pull-secret-syncer/0.log" Jun 11 17:27:07.460008 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:07.459967 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x5zjm_76b1dbe2-fe88-439f-9364-2b6d510dd976/konnectivity-agent/0.log" Jun 11 17:27:07.560637 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:07.560598 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-76.ec2.internal_6a27aac0db19b06d35dee5533ce37c71/haproxy/0.log" Jun 11 17:27:11.645802 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:11.645752 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4_d64550a0-5c48-4803-9de3-36c77f8576ea/extract/0.log" Jun 11 17:27:11.682815 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:11.682783 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4_d64550a0-5c48-4803-9de3-36c77f8576ea/util/0.log" Jun 11 17:27:11.710873 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:11.710841 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9nz4_d64550a0-5c48-4803-9de3-36c77f8576ea/pull/0.log" Jun 11 17:27:11.745523 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:11.745418 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh_5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5/extract/0.log" Jun 11 17:27:11.773885 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:11.773852 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh_5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5/util/0.log" Jun 11 17:27:11.830726 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:11.830568 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tf9gh_5e23d9ad-bd79-4185-9fb4-4f6cc1b63cf5/pull/0.log" Jun 11 17:27:11.901808 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:11.901724 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj_722101c5-4f4f-465d-b9dd-166004a3ef4c/extract/0.log" Jun 11 17:27:11.950354 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:11.950313 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj_722101c5-4f4f-465d-b9dd-166004a3ef4c/util/0.log" Jun 11 17:27:11.994530 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:11.994498 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzkqj_722101c5-4f4f-465d-b9dd-166004a3ef4c/pull/0.log" Jun 11 17:27:12.028941 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:12.028911 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq_4be8a280-e763-406e-9fdf-15aed9cacbd7/extract/0.log" Jun 11 17:27:12.056813 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:12.056776 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq_4be8a280-e763-406e-9fdf-15aed9cacbd7/util/0.log" Jun 11 17:27:12.080278 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:12.080244 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fw7cq_4be8a280-e763-406e-9fdf-15aed9cacbd7/pull/0.log" Jun 11 17:27:12.437840 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:12.437808 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vsk8p_320c5f0b-8864-4385-becc-579dade89a90/manager/0.log" Jun 11 17:27:12.534209 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:12.534172 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rz6jj_7ad17bc1-7b58-4a83-acc7-578c8b1b94f0/registry-server/0.log" Jun 11 17:27:14.512861 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:14.512822 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-f47lw_e9fb72e8-f289-4a65-8827-3929f0fd4568/kube-state-metrics/0.log" Jun 11 17:27:14.548251 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:14.548218 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-f47lw_e9fb72e8-f289-4a65-8827-3929f0fd4568/kube-rbac-proxy-main/0.log" Jun 11 17:27:14.574292 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:14.574259 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-f47lw_e9fb72e8-f289-4a65-8827-3929f0fd4568/kube-rbac-proxy-self/0.log" Jun 11 17:27:14.817187 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:14.816803 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h2fcp_b97f2442-6b31-48ed-9c58-2e3e39f2f7bf/node-exporter/0.log" Jun 11 17:27:14.847835 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:14.847811 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h2fcp_b97f2442-6b31-48ed-9c58-2e3e39f2f7bf/kube-rbac-proxy/0.log" Jun 11 17:27:14.882647 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:14.882615 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h2fcp_b97f2442-6b31-48ed-9c58-2e3e39f2f7bf/init-textfile/0.log" Jun 11 17:27:15.003834 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:15.003803 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hlp59_484281b1-4bc3-42a4-b983-68d1dba96973/kube-rbac-proxy-main/0.log" Jun 11 17:27:15.036632 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:15.036541 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hlp59_484281b1-4bc3-42a4-b983-68d1dba96973/kube-rbac-proxy-self/0.log" Jun 11 17:27:15.067558 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:15.067529 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hlp59_484281b1-4bc3-42a4-b983-68d1dba96973/openshift-state-metrics/0.log" Jun 11 17:27:15.471229 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:15.470584 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-trs9v_c4b9e705-e2f6-451a-89f9-5269541c5cb6/prometheus-operator-admission-webhook/0.log" Jun 11 17:27:15.610895 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:15.610864 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fcd8c8f5f-8fr9j_b582517d-b88e-4a6d-8d31-65d1bba712ac/thanos-query/0.log" Jun 11 17:27:15.648093 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:15.648064 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fcd8c8f5f-8fr9j_b582517d-b88e-4a6d-8d31-65d1bba712ac/kube-rbac-proxy-web/0.log" Jun 11 17:27:15.674830 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:15.674805 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fcd8c8f5f-8fr9j_b582517d-b88e-4a6d-8d31-65d1bba712ac/kube-rbac-proxy/0.log" Jun 11 17:27:15.701224 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:15.701192 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fcd8c8f5f-8fr9j_b582517d-b88e-4a6d-8d31-65d1bba712ac/prom-label-proxy/0.log" Jun 11 17:27:15.732797 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:15.732714 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fcd8c8f5f-8fr9j_b582517d-b88e-4a6d-8d31-65d1bba712ac/kube-rbac-proxy-rules/0.log" Jun 11 17:27:15.761854 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:15.761811 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fcd8c8f5f-8fr9j_b582517d-b88e-4a6d-8d31-65d1bba712ac/kube-rbac-proxy-metrics/0.log" Jun 11 17:27:18.298544 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.298459 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-576d584b54-2s282_a966bdaf-1dad-47a7-a728-898239f297c1/console/0.log" Jun 11 17:27:18.524465 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.524414 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx"] Jun 11 17:27:18.530865 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.530829 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.536411 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.536380 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx"] Jun 11 17:27:18.609365 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.609329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-podres\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.609733 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.609695 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjrzt\" (UniqueName: \"kubernetes.io/projected/f01ee0b9-afed-4f0f-a781-701172720108-kube-api-access-bjrzt\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.609954 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.609939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-sys\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.610096 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.610082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-lib-modules\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.610241 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.610228 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-proc\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.711165 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.711125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-lib-modules\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.711442 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.711414 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-lib-modules\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.711626 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.711496 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-proc\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.711738 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.711506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-proc\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.711897 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.711881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-podres\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.712030 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.712013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjrzt\" (UniqueName: \"kubernetes.io/projected/f01ee0b9-afed-4f0f-a781-701172720108-kube-api-access-bjrzt\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.712212 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.712193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-sys\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.712423 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.712405 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-sys\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.712650 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.712633 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f01ee0b9-afed-4f0f-a781-701172720108-podres\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.729143 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.729112 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjrzt\" (UniqueName: \"kubernetes.io/projected/f01ee0b9-afed-4f0f-a781-701172720108-kube-api-access-bjrzt\") pod \"perf-node-gather-daemonset-w7cvx\" (UID: \"f01ee0b9-afed-4f0f-a781-701172720108\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:18.844411 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:18.844373 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:19.043840 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:19.043804 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx"] Jun 11 17:27:19.605058 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:19.604961 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" event={"ID":"f01ee0b9-afed-4f0f-a781-701172720108","Type":"ContainerStarted","Data":"34ede769f4489b559d182b70bc371bbb0fdcb9e1e6fb56e573d8ee060f7d28f5"} Jun 11 17:27:19.605058 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:19.605027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" event={"ID":"f01ee0b9-afed-4f0f-a781-701172720108","Type":"ContainerStarted","Data":"055595083cc96218df0dcb1af85bf974eff1c02fed57e4a890a5dba31446bf46"} Jun 11 17:27:19.605496 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:19.605060 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:19.624626 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:19.624575 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" podStartSLOduration=1.624559959 podStartE2EDuration="1.624559959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:27:19.623366649 +0000 UTC m=+2592.601842178" watchObservedRunningTime="2026-06-11 17:27:19.624559959 +0000 UTC m=+2592.603035488" Jun 11 17:27:20.364745 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:20.364713 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qbhdp_99d2f1d8-f3f3-4c6f-97f0-c768caae1caf/dns/0.log" Jun 11 17:27:20.391421 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:20.391361 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qbhdp_99d2f1d8-f3f3-4c6f-97f0-c768caae1caf/kube-rbac-proxy/0.log" Jun 11 17:27:20.494843 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:20.494813 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tzg8h_090876e6-05f9-4e60-9e0c-a5dddc8571af/dns-node-resolver/0.log" Jun 11 17:27:21.185779 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:21.185742 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n45kd_b95027c8-1005-4bdf-b0cf-c095e8d14eb9/node-ca/0.log" Jun 11 17:27:22.219037 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:22.219004 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mhgjf_18220b0b-b691-403a-9493-eaa632bcbe6e/istio-proxy/0.log" Jun 11 17:27:22.388636 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:22.388607 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-cj886_158ef541-0a86-4052-968b-4df7854a2445/istio-proxy/0.log" Jun 11 17:27:22.448182 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:22.448153 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-cj886_158ef541-0a86-4052-968b-4df7854a2445/istio-proxy/1.log" Jun 11 17:27:23.286201 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:23.286166 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fd824_49e31301-ebf6-493b-91e9-2525a50c4dd6/serve-healthcheck-canary/0.log" Jun 11 17:27:24.053072 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:24.053040 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f96sw_cb802322-ddff-433f-a837-692cf97d8908/kube-rbac-proxy/0.log" Jun 11 17:27:24.097759 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:24.097726 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f96sw_cb802322-ddff-433f-a837-692cf97d8908/exporter/0.log" Jun 11 17:27:24.135899 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:24.135864 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f96sw_cb802322-ddff-433f-a837-692cf97d8908/extractor/0.log" Jun 11 17:27:25.622250 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:25.622217 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-w7cvx" Jun 11 17:27:26.653865 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:26.653836 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6879556547-5kjm6_a654fc02-c562-4021-a93b-2aa0d016d2e9/nginx/0.log" Jun 11 17:27:26.890925 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:26.890852 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686620-6wclg_532388ab-fb41-41a4-9be6-bf21271d2b0a/cleanup/0.log" Jun 11 17:27:26.926524 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:26.926412 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686635-9t5d5_31c39b29-503d-4a88-94c7-1b1e883bf409/cleanup/0.log" Jun 11 17:27:27.309427 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:27.309335 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f54898884-n9jn2_8c128f70-8b95-453e-84d1-03769c16daa1/manager/0.log" Jun 11 17:27:27.343007 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:27.342977 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f54898884-n9jn2_8c128f70-8b95-453e-84d1-03769c16daa1/copy-manifests/0.log" Jun 11 17:27:27.442140 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:27.442105 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-w4vtq_f720755d-11cc-4a4a-b124-5b11d42ff875/postgres/0.log" Jun 11 17:27:29.258494 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:29.258434 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57b9974d87-tr279_9c42f7ef-c294-4121-9713-cd6605c9adbf/manager/0.log" Jun 11 17:27:29.285555 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:29.285525 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8zm42_dc697f82-382a-4a87-8010-ea86ea76fe3b/openshift-lws-operator/0.log" Jun 11 17:27:31.803840 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:31.803804 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mhgjf_18220b0b-b691-403a-9493-eaa632bcbe6e/istio-proxy/0.log" Jun 11 17:27:31.920385 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:31.920353 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-cj886_158ef541-0a86-4052-968b-4df7854a2445/istio-proxy/0.log" Jun 11 17:27:31.990981 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:31.990946 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-cj886_158ef541-0a86-4052-968b-4df7854a2445/istio-proxy/1.log" Jun 11 17:27:33.180664 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:33.180635 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mhgjf_18220b0b-b691-403a-9493-eaa632bcbe6e/istio-proxy/0.log" Jun 11 17:27:33.300174 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:33.300137 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-cj886_158ef541-0a86-4052-968b-4df7854a2445/istio-proxy/0.log" Jun 11 17:27:33.363217 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:33.363178 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-cj886_158ef541-0a86-4052-968b-4df7854a2445/istio-proxy/1.log" Jun 11 17:27:35.143241 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:35.143209 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mhgjf_18220b0b-b691-403a-9493-eaa632bcbe6e/istio-proxy/0.log" Jun 11 17:27:35.243255 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:35.243221 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-cj886_158ef541-0a86-4052-968b-4df7854a2445/istio-proxy/0.log" Jun 11 17:27:35.309392 ip-10-0-129-76 kubenswrapper[2580]: I0611 17:27:35.309351 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-cj886_158ef541-0a86-4052-968b-4df7854a2445/istio-proxy/1.log"